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EDITOR’S NOTE 


The development of objective tests in education has been 
passing through the various critical stages involved in render- 
ing them more and more perfect instruments of procedures. 
The methods of refinement relied upon have been closely 
related to the inner technique of mathematical theorj-. Dur- 
ing a period of intensive use of these tests, the author of this 
monograph came upon the problem of the possible value of 
an early introduction to an intelligent use of tests and scales 
for determining a more effective procedure in the training of 
teachers. In March, 1924. Dr. Snyder received the first award 
of the Fellowship for Research in Education offered by Pi 
Lambda Theta, the honorarj- fraternity for women in educa- 
tion. Its generous stipend enabled her to carr)- through a 
larger project during 1924-1925 with the hope of findit^ a 
more definite answer to her question; Does skill in using 
.selected educational tests function in teacher-training? The 
Department of Education of The Johns Hopkins University, 
in appreciation of the award, welcomed the unusual oppor- 
tunity thus offered to hunt for any new values accruing in the 
use of tests. It seemed reasonable to hope that all past evi- 
dences of the value of the use of standardized measures by 
teachers in service would be enhanced by discovering some 
positive t'alues in the course of teacher-training. While it 
is recognized that the author’s findings are not absolutely 
conclusive, it is hoped that her efforts to analyze a compli- 
cated situation will point the way for new experimental efforts 
to measure changes in the early growth in teaching skills and 
attitudes by means of resultant changes in pupil learning. 

E. F. B. 
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CHAPTER I 


The Present Status of Educational Measurements in 
Teacher Training Institutions 

I. survey OF the LITERATURE 

The field of educational literature is rich in studies dealing 
with the practical application of the measurement movement 
to classroom procedure. Nothing, however, has been done to 
subject the value of tests and measurements in the pre-service 
training of teachers to experimental study. It is true that the 
journals report occasional articles which indicate that tests 
and measurements are being used in the training of teachers ; 
but, as a rule, such studies are conducted on a small scale and 
with a view to the immediate improvement of instruction 
rather than with the purpose of putting the worth of the 
procedure in the training of student teachers to experimental 
test. Of such type is a report by Emma B. Grant. ‘ Here, a 
class of 34 senior students in a city training school tested and 
diagnosed the reading ability of a practice class and made 
definite recommendations for follow-up work to the teacher 
of practice. M. E. James’ gives a similar report of work 
done in the State Normal School at Salem, Massachusetts. 
Mary A. Grupe and Elsa M. Smith ’ give evidence that work 
of the children in the fundamentals is kept up to standard in 
training classes. There is implication that the student teach- 
ers participate in the work, but there is no indication that 
emphasis is placed upon the definite training of the students 
in the use of the results of testing programs. 

’Grant, “Motivating the Course in Tests and Measurements for 
the Teacher-in-Training,” Journal of Educational Method, IV, ipas. 

’ James, “ Using the Results of Measurement in Reading in Training 
Student Teachers,” Elementary School Journal, XXII, 1922, pp. 190-96. 

’ Grupe and Smith. “ The Use of Educational Measurements in the 
Training Department of the State Normal School, Ellensburg, Wash- 
ington,” Educational Administration, VII, 1921, pp. 517-26. 

I 
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Becau‘;e the yielfl of reported studies was so small and 
because also it was believed desirable to collect certain con- 
tributory data, it was decided to use the questionnaire method 
in order to determine the present status of the use of tests 
and measurements in teacher training institutions. The ques- 
tionnaires were differentiated to suit the three main types of 
institutions dealing with teacher training : 

1. Those with no other function than teacher training ; i. e., teacher 
training and normal schools. 

2. Departments or schools of education in colleges and universities. 

3. Bureaus of Research in their cooperative function in teacher 
training. 

A summary only of the results of this phase of the work is 
given here. A complete report is on file in the library of 
The Johns Hopkins University. 

2 . EDUCATIONAL MEASUREMENTS IN TEAC HER TRAINING 
INSTITUTIONS 

Questionnaires (Appendix A) were sent in October, 1924, 
to the 279 public teacher training institutions listed in Bulle- 
tin, 1924, No. 10, Department of the Interior, Bureau of 
Education, Statistics of Teachers Colleges and Normal 
Schools 1931-22. Replies were received as follows : Alabama, 
3 ; California, 3 ; Colorado. 2 ; Connecticut, i ; Georgia, i ; 
Hawaii, i ; Illinois, 3 ; Indiana, 3 ; Iowa, 2 ; Louisiana, 2 ; 
Maine, i; Maryland, 4; Massachusetts, 3; Michigan, 15; 
Minnesota, 3 ; Missouri, 3 ; Montana, i ; New Hampshire, 2 ; 
New Jersey, 2; New York, 9; North Carolina, 4; North 
Dakota, 4 ; Ohio, 1 1 ; Oklahoma, 4 ; South Dakota, i ; Texas, 
I ; Virginia, i. In all, 90 blanks were returned either wholly 
or partially answered and, in addition, 5 letters were received 
which gave information of value to the study. The replies 
included 56 state, i territorial, 15 city, and 23 county insti- 
tutions. The following tyjies of institutions were represented : 
1 School of Education, 4 Teacher Training Schools, 6 
City Normal Schools, 3 Teachers Colleges, i City Normal 
Training School, 3 County Training Schools, 20 County 
Normal Schools, 34 State Normal Schools, 22 State Teach- 
ers Colleges, Normal Colleges and Normal Universities, and 
I Territorial Normal Training School. 
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A summary of the results is offered in order of the nine 
headings of the questionnaire : 

I. Catalogue Name or Names of Courses in Which Train- 
ing in the Use of Educational Tests and Measurements is 
Given. — From 95 replies, we learn that 68 institutions gave 
definite courses m tests and measurements, 18 included such 
instruction in other courses, and 9 — for the most part small 
county normal schools — gave no such courses. The relative 
frequency of the three practices — ^the specific course, inclu- 
sion in other courses, and no course — is indicated in terms of 
percent in Figure i. The institutions giving specific courses 



Figure i — The relative frequenqr m 95 teacher training institutions 
of those giving specific courses m tests and measurements, of those 
including such work in other courses, and of those giving no such 
courses 

in tests and measurements listed such courses variously, but, 
in general, the designations fell into the following classifi- 
cation : 

Courses including one or both words, “ tests ’’ and “ measure- 
ments,” in title . . 46 

Courses mcluding one or both words, “ mental ” and " intelligence,” 
in title , 7 

Courses giving psychological designations 9 

Courses giving only catalogue numbers 18 


Total 


80 
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It wi]l be noted that the 68 insdtutioiis gave a total of 8o 
courses, indicating an average of i.i8 courses to an insd- 
tution, 

2. Enrollment. — ^There were 42 definite replies. It was 
found that in 26 institutions in which courses in tests and 
measurements were required or in which some of such courses 
were required and some elective, there was an average total 
enrollment of 302.5 and an average enrollment in courses in 
tests and measurements of 62.5. In 16 institutions ha\-ing 
elective courses only, the average total enrollment was 969 
with an average enrollment in courses in tests and measure- 
ments of 30. Thus it is seen that the institutions in which 
courses in tests and measurements were elective were the 
larger institutions, while the enrollment in these elective 
courses was very much smaller than in institutions in which 
the courses were required. 

3. Teaching Staff. — There were 46 inclusive replies. Of 
these, only 5 indicated that full-time instrvctors in tests and 
measurements were employed, while 41 indicated that part 
of one or more instructors’ time was so employed. The me- 
dian number on the entire teaching staff was 36. while the 
median amount of time given to instruction in tests and mea- 
surements was one-fifth of one instructor's time. 

4. School Year. — The 59 replies indicated a school year 
ranging from 32 to 48 weeks with both median and Qi at 38 
weeks. The length of courses in tests and measurements 
ranged from 6 to 36 weeks with both Qi and the median at 
12 and Qa at 18. The trimester division of the school year 
prevailed, and courses in tests and measurements were, in 
general, limited to one 12-week term. 

5. Salaries. — ^There were so many different interpretations 
of this item that, although it was treated in nearly all of the 
blanks, only 44 answers could be used. The data indicate that 
where full time or more than full time of one instructor was 
given to courses in tests and measurements, the average ex- 
penditure was $3000, but that the prevailing condition, i. e., 
the use of part of an instructor’s time for such courses. 
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required, on the average, an annual expenditure of $806.50 
for one such course covering a period of 12 weeks. 

6. Expenditure Other Than Salaries. — There were but 
24 answers sufficiently inclusive to be of value. Again, the 
expenditure was slight, amounting to a median expenditure 
of $50 for equipment and supplies and $26.67 for assistance. 
The meagre amounts given may mean, as some letters accom- 
panying the questionnaires seemed to indicate, that the budget 
system emplo3-ed made the accurate accounting of specific 
items such as this, practically impossible. 

7. Testing Program in Schools Outside of Institution. — 
There were but 33 complete replies to this section indicating 
that a testing program was conducted as part of a course in 
tests and measurements. In addition, 16 stated definitely that 
no such program was carried on, while 9 others stated that 
there wa.s such a program but gave no details. The results 
show an evident effort to make courses in tests and measure- 
ments practical by incorporating testing programs in them. 
As a rule, such programs were limited to a small number of 
schools, frequently to the training school connected with the 
institution. 

8. Cost of Testing Program. — There were but 17 com- 
plete replies. These indicated expenditures ranging from $5 
to $700 with a median expenditure of $50 which was defrayed 
in 10 out of the 17 cases by the institution, 3 by the institu- 
tion and the cooperating school system, and 4 1^ other sources. 

9. Use Other Than the More Effective Training of Stu- 
dents Made of the Data Gathered in the Testing Program. — 
There were 39 replies to this question. Of these, 12 indicated 
that no use other than the more effective instruction of the 
students was made of the data. The 27 replies indicating that 
some other use was made of the results may be summarized 
as follows : 

Replica 


For classification of pnpils 9 

Supervision of instruction 14 

Use in superintendent’s ofiice i 

Instruction and classification 2 

Special experimental work 1 
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3; EDUCATIONAL MEASUREMENTS IN DEPARTMENTS AND 
SCHOOLS OF EDUCATION IN COLLEGES AND 
UNIVERSITIES 

Scope of the Investigation. — Questionnaires (Appendix A) 
were sent to the state university of each state and to 10 lead- 
ing universities. In all, 24 replies, representative of 21 states 
and one island territory, were received. The following states 
and territory were represented: California, Colorado, Florida, 
Illinois, Kentucky, Maine, Maryland, Massachusetts, Michi- 
gan, Minnesota, Mississippi, Missouri, Nevada, New Hamp- 
shire, New York, North Carolina, Rhode Island, South Da- 
kota, Tennessee, Washington, Wisconsin, and Porto Rico. 
The situation thus revealed may be summarized as follows: 

I. Catalogue Name or Names of Courses in Which Train- 
ing in the Use of Educational Tests and Measurements is 
Given. — There were 22 replies to this item with a total of 
S3 courses or an average of 241 courses to an institution. In 
12 cases, catalogue numbers only were given to designate the 
course, while in the 41 remaining institutions, 30 different 
titles were indicated. Because of the variety of designations 
and the implication of differentiation in the field of tests and 
measurements which such variety gives, these titles are given 
in full : 


Educational Tests and Measurements 5 

Tests and Measurements 3 

Educational Measurements 3 

Statistical Methods in Education 3 

Intelligence and Educational Measurements i 

Tests of Intelligence i 

Administration of Education i 

Mental and Educational Measurements 3 

Individual and Group Intelligence Testing i 

Administration of Tests, and Tabulations, Interpreta- 
tion, and Use of Test Results i 

Seminary of Educational and Intelligence Testing i 

Eiducational Psychology i 

Educational Diagnosis 1 

Statistical Meth^ i 

Mental Tests and Mental Diagnosis i 

Individual Mental Examinations i 

Psycho-Educational Clinic i 

Measurement and Experiment in Elementary Education l 
Measurement in High Schools i 

Measurement in Secondary Education l 
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Mea<iurement and Experiment in Kindergarten and 
First Grade i 

Educational Measurement in Elementary School l 

Measurement in Secondary Schools i 

Problems in Educational Measurement i 

Experimental Education i 

Personnel Research in High Schools i 

Personnel Research in Elementary School i 

Introduction to Educational Measurements i 

Seminary in Educational Measurements i 

Elementary School Surveys and Tests i 

Total 41 

2. Enrollment. — There were 14 replies to this item. 
Enrollment in entire departments ranged from 122 to 2500 
with a median enrollment of 268.5, while enrollment in 
courses in tests and measurements ranged from 6 to 1473 
with a median enrollment of 43. In 9 cases, the courses were 
designated as elective, in 2 as required, and in i as required 
for special curricula. It will be noted that this condition is 
the opposite of that prevailing in teacher training institutions 
where, in by far the greater number of cases, courses in tests 
and measurements were required. 

3. Teaching Staff. — There were but 18 complete answers 
to this unit of which but 2 indicate that instructors gave 
full time to courses in tests and measurements. In those in- 
stitutions in which part of one or more instructors’ time was 
used for such courses, the amount of time ranged from 1/20 
to 2\ with a median of \ of one instructor’s time. Here, the 
condition was found to be similar to that in teacher training 
institutions, the prevailing tendency being toward the use of 
one instructor’s time, the average fractional part of such time 
being somewhat greater than in teacher training institutions. 

4. School Year. — ^There were 22 answers to this item. They 
indicated a school year ranging from 32 to 48 weeks with 
median, Qi, and Qs at 36, and courses in tests and measure- 
ments ranging from 12 to 40 weeks with median at i8, Qi at 
17, and Q3 at 34 weeks. The semester course was shown to be 
the prevailing one in length of time as was the trimester 
course in teacher training institutions. 

5. Salaries. — The 15 replies indicated a range of expendi- 
tures on salaries of entire departments of education of from 
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$8400 to 8147,825 with a median expenditure of $19,400 and 
a range of expenditures on salaries of instructors in tests and 
measurements of from $500 to $8850 with a median expen- 
diture of $1610. 

6. Expenditure Other Than Salaries. — There were 14 re- 
plies. These indicated a range of expenditure for equipment 
and supplies of from Si 7 to $500 with a median expenditure 
of $75 and a range of expenditure on assistance of from 
$0 to $2000 with a median of $0. These amounts are not very 
different from those similarly spent by teacher training insti- 
tutions, the amount on equipment and supplies being slightly 
greater and that on assistance being slightly less in the present 
instance. 

7. Testing Program in Schools Outside of Institution. — 
There were 15 replies indicating that a testing program had 
been carried out in connection with the course or courses and 
3 indicating that there had been no such program. Again, 
as in the case of teacher training institutions, effort has evi- 
dently been made to make courses in tests and measurements 
practical by incorporating testing programs in them. 

8. Cost of Testing Program. — There were but 5 replies 
indicating the cost of testing programs. These ranged from 
$0 to $2250 with a median of S300. Of ii replies indicating 
how the expenses were defrayed, there were 3 in which such 
expenses were born entirely by the institution, 3 by the insti- 
tution and other sources, and 5 by other sources, the last 
including local schools, the system surveyed, the schools tested, 
and workers in the class. The replies indicated a somewhat 
higher expenditure than in teacher training institutions and 
that expenses were borne either in entirety or in part by out- 
side agencies to a greater extent than in teacher training insti- 
tutions. 

9. Use Other Than the More Effective Training of Stu- 
dents Made of the Data Gathered in the Testing Program. — 
Since there were but 13 replies, these are quoted here: 

“Used by supervisors of schools.” "Effort was made to discover 
special aptitudes or difficulties.” “No.” “Yes, study of Junior High 
School achievement in the light of educational and vocational choices.” 
“ Yes, to help the school.” " Each school supplied with individual 
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record cards, class records, general summaries for system, recommen- 
dations for reclassification and remedial instruction.” “Used by prin- 
cipals in classifying students; by teachers in evaluating work; by 
professor in charge to illustrate measurement in public talks.” “ Classi- 
fication of pupils; basis for supervision and remedial teaching, scaling 
of tests; sundry studies of educational problems, etc.” "Results given 
to local teachers.” “ Classification use in the schools tested.” “ Usual 
administrative uses. Each teacher, as a rule, examined thoroughly 
her own pupils and used results for sectioning, grading, promoting, 
etc.” “ Classification into sections of a junior high school.” “ By local 
principal and teachers in work of supervision.” 

4. COOPERATION OF BUREAU’S OF EDUCATIONAL RESEARCH 
WITH TEACHER TRAINING INSTITUTIONS 

Questionnaires (Appendix B) were sent to the 64 Research 
Bureaus maintained by city systems and to the 8 of the 49 
research agencies maintained by higher institutions not in- 
cluded in institutions to whom one or the other of the 2 
questionnaires had been sent. Of this total of 72, 65 replies 
were received. It is interesting to note that 35 different desig- 
nations appeared in the titles of these bureaus. Of these, the 
most common was “ Department of Educational Research,” 
the designation given to 20 of the number. The next most 
common was “ Department of Research," the name given to 6. 
Other names indicated specific functions such as “ guidance,” 
“ statistics,” “ classification,” “ building program,” “ psycho- 
logical research,” “ measurement,” “ efficiency,” “ survey,” 
"attendance,” "child study.” The following summary of 
results is offered : 

I. Cooperation with Teacher Training Institution or De- 
partment or School of Education of a College or Univer- 
sity. — Of the 65 total replies, 44 indicated some kind of coop- 
eration. Of these, 39 indicated the type institution with which 
cooperation was carried on ; 


State Universities 26 

State Teachers’ Colleges 9 

Normal Schools 3 

City Training Schools i 

Total 39 


2. Courses Given in Educational Institutions by Members 
of Research Bureau. — There were 65 replies. Of these, 30 
indicated that members of the research staff gave courses in 
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tests and measurements in cooiierating institutions, while 35 
indicated that no such instruction was given. Of the 30 giv- 
ing such instruction, 5 specified that the instruction was given 
in extension courses, and i that a course was given to teach- 
ers and principals. 

3. Length of Courses in Weeks Per Year; Number of 
Periods Per Week; Length of Periods. — ^There were 35 
complete replies. The number of weeks per year ranged from 
6 to 42 with a median of 18 ; the number of periods per week 
ranged from i to 7 with a median of 2, and the length of the 
periods ranged from 50 minutes to 2 hours with a median of 
I hour. 

4. How the Cost of Instruction Is Met. — ^There were 29 
answers as follows : 

Cost met entirely by teacher training institution 26 

Cost met by bureau of research and educational institution coopera- 
tively 3 

Total 29 

5. Amount Appropriated in 1923-24 by the Bureau of Re- 

search for Instructional Purposes. — But one of the three 
institutions which indicated that the instructional cost was 
met by the bureau of research in cooperation with the edu- 
cational institution answered Item 5. In this case the amount 
was $2200. 

6. Testing Programs in Cooperation with the Teacher 
Training Institution. — ^There were 33 replies to this question, 
22 of which indicated that cooperative testing programs were 
conducted and ii that no such cooperative testing programs 
were conducted. 

7 and 8. Amount Spent on Testing Programs (Both Items 
Include Details of Costs). — ^There were but 8 complete re- 
plies to these items, these 8 having a range in total expen- 
ditures of from $10 to $5^5° with a median expenditure of 
$740. There were 1 1 replies indicating a range of from $50 
to $3000 with a median of $500 expended on clerical 
assistance. 

9. Benefits of Cooperative Plan to Teacher Training Insti- 
tution and to Bureau of Research. — There were 23 replies. 
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The benefits to the teacher training institution indicated were : 
The advantage of close contact with the field ; the coordina- 
tion of theory and practice ; the opportunity of extending the 
work of the institution to teachers in service ; and the supply 
of current data for research. The benefits to the bureau indi- 
cated were : The greater interest of the teachers in the pro- 
gram of the bureau ; the advantage of securing student help 
in carrying out testing programs ; and the extension of the 
service of the bureau. 

5. COMPARISON OF RESULTS OF STUDY OF THE USE OF TESTS 
AND MEASUREMENTS BY THE THREE TYPES OF 
INSTITUTIONS INVESTIGATED 

The preceding investigation is based upon a study of 95 
teacher training institutions, 24 departments or schools of 
education in colleges and universities and 62 Bureaus of Edu- 
cational Research, giving a total of 184 institutions. The 
replies indicated the following conditions : 

1. Courses in tests and measurements were general in 
teacher training institutions and departments or schools of 
education in colleges and universities. There was also a ten- 
dency to utilize the services of members of the staffs of Bu- 
reaus of Research in the giving of such courses in coopera- 
tion with teacher training institutions which were, in the 
majority of cases, departments or schools of education in 
colleges and universities. To a lesser extent, more so in 
teacher training institutions than in colleges and universities, 
instruction in the use of tests and measurements was given in 
other educational courses ; e. g., School Management ” and 
“ Principles of Education.” 

2. Courses in tests and measurements were for the most 
part required in teacher training institutions and elective in 
colleges and universities. 

3. In both types of institutions — and also in the courses 
given by members of the staffs of Bureaus of Research — ^the 
instructors in these courses gave only part of their time to 
this field of work. 
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4. While the inadequacy of the data made a thorough-going 
study of costs impossible, the expenditure for all phases of 
this work appeared to be low. 

5. Testing programs generally accompanied such courses, 
effort usually being made to give service to the schools tested 
while providing professional education in the use of tests to 
the students in the course. 

6. The tendency of having the schools or systems tested 
share in the expense of the testing program was indicated 
particularly in the case of colleges and universities. 

7. While various expressions of the use made of such 
testing programs were given, in no case was there indication 
that they were used as part of a definite program in the 
training of student teachers as is the case in the present study. 



CHAPTER II 

The Problem, the Criteria, and the Plan of Solution 
I. the problem 

The preceding chapter shows a general tendency to include 
courses in tests and measurements in the curricula of teacher 
training institutions. It also shows an effort to make such 
courses practical by linking them with testing programs and 
with instructional procedure in elementary school situations. 
The present study is an attempt to measure the worth of 
instruction in the use of tests and measurements in so far as 
such instruction enters into the direct pre-service training of 
teachers during the student teaching period. The study makes 
no attempt to measure the general value of courses in tests 
and measurements as part of a teacher training curriculum. 
Neither does it attempt to measure the value of the appar- 
ently prevalent practice of having the students in such courses 
participate in test surveys of school systems. Instead, it con- 
fines itself to what is assumed should be the point of emphasis 
in such courses, i. e., instruction in the use of the results of 
standard tests in teaching the children tested. 

With the above limitation in mind and with the further 
limitations of scope necessitated by the practical considera- 
tions of time and available school situations, the following 
statement of the problem is given : 

The place and value of training student teachers to use 
skillfully the results from general and diagnostic tests in the 
instruction of children. 

Will a typical group of settlors in a normal school grow 
more in ability to teach children if they base their instruction 
upon the analyses of general and diagnostic tests than will a 
similar group of seniors who do not use tests as a basis of 
instruction f 

Both groups teach for equal lengths of time in Grades j, 4, 
and 5, the first group spending three thirty-minute periods 
per week in test-determined teaching of reading; an equal 
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amount in arithmetic (fundamentals and problems); and 
three hfteen-minute periods per week in spelling over a 
period of not less than six weeks. 

2 . THE CRITERIA 

Since the problem is centered about the effect of the use 
of the results of tests upon the growth in teaching skill of the 
student teacher, the criteria selected for the determination of 
such growth in skill are of the utmost importance. Study of 
the literature on the rating of teaching shows a general ten- 
dency to place such rating upon a twofold basis : 

1. Progress made by the children taught. 

2. The worth of instruction as observable in the classroom. 

It is generally accepted that if sufficiently accurate and 

adequate measures of pupils’ progress could be secured, prac- 
tically no other criterion need be considered. E. C. Elliott, for 
example, urges that stress in teacher rating be placed upon 
“ clearly-defined results of teaching rather than upon formal 
procedure or upon personal factors of presumptive educa- 
tional worth.” ‘ 

The difficulty of getting such a measure of results is clearly 
expressed by W. ^I. Davidson as follows : “ The effect of 
the teacher’s qualities upon the pupils may be outstanding; 
but they may be so subtle as to escape hasty inexpert inspec- 
tion. Effects upon the literary taste of the pupils or upon 
their attitude toward problems of conduct, for example, are 
far more subtle than effects upon their accuracy in spelling or 

upon their facility in arithmetic It sometimes happens 

that the supervisor tends to ascribe to the qualities of the 
teacher effects which are simply due to the increasing matur- 
ity and out-of-school experience of the pupils. The qualities 
observable in the teacher should serve as a check upon this 
fallacy.’”' 

‘Elliott, E. C. “How Shall the Merit of Teachers be Tested and 
Recorded?” Educational Administration and Supervision, I, 1915, pp. 
291-299. 

‘Davidson, W. M. “How to Measure the Efficiency of Teachers,” 
National Education Association Addresses and Proceedings, 1913, 
p. 286. 
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Again, S. A. Courtis, in mapping out a program for plac- 
ing teacher rating upon a scientific basis makes " definition of 
teaching ability wholly in terms of the changes to be pro- 
duced in children ” the first step. He expresses, however, the 
difficulty of this step and the inadequacy of our present mea- 
sures in the following statement: ‘‘Self-development, self- 
appraisal, self-control, cooperation do not show in standard 
tests. That is why, at present, there is so little correlation 
between teaching ability and scores in standard tests.” ‘ 

B. F. Pittinger gives three possible planes upon which a 
teacher can be rated : 

1. The plane of results or of pupil achievement. 

2. The plane of the teaching and learning process. 

3. The plane of the teacher’s equipment for teaching, both native 
and acquired.’ 

He would measure the plane of results only, were it possi- 
ble to do so effectively: but because of the impossibility of 
measuring all the results of teaching or of picking out from 
the body of measured results any single teacher's contribu- 
tion, he recommends concentration upon the classroom proc- 
ess as being more measurable, the rating to include both 
teacher and pupil activities. 

Compared with the general problem of measuring teacher 
growth, the problem presented in this study is simple. Here, 
the immediate interest is limited to the teaching of three 
subjects, progress in which can be submitted to objective test. 
Hence a comparison between the growth of the children of 
the experimental and control classes in reading, spelling, and 
arithmetic abilities as measured by the difference between 
the scores made in the standard tests in those subjects given 
at the beginning and those made in the tests given at the end 
of the experiment is used as the main criterion of the growth 
in teaching skill of the two groups of students teaching those 
classes. 

’Courtis, S. A. “Standards of Teaching Ability,” Educational 
Review, LXII, p. 185. 

’Pittinger, B. F. “Problems of Teacher Measurement, Jonnml 
of Educational Psychology, VllI, p. 104. 
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While it is understood that the above criterion would serve 
to establish the growth in teaching skill only in the three sub- 
jects tested, even within these narrow limits other factors, 
as suggested by N. N. Davidson, might operate to obscure 
the importance of the training of the student teacher to use 
test results as a factor in the progress made by the children. 
In order to determine as accurately as possible the relative 
influence of such training as measured by the progress of the 
children, it was decided to measure, in so far as the circum- 
stances surrounding the present experiment permitted, every 
possible variable that might affect the progress of the children. 

If, measured by this criterion, the present study should 
indicate that better teachers of reading, spelling, and arith- 
metic could be produced through training in the use of test 
results, or even if the indications should point to the results 
in but one of these three subjects, the results would be of 
significance in the general problem of teacher training. If. 
on the other hand, the results should indicate that such spe- 
cific training affected the general teaching skill of the student 
teacher, the significance of such procedure in the teacher 
training problem would be immeasurably greater. To get 
such a general measure means the use of the second criterion 
mentioned above, i. e., the worth of instruction as observable 
in the classroom. 

In the present status of the teacher rating problem, a mea- 
sure of the worth of instruction as observable in the class- 
room is so clouded in obscurities as to render any results 
obtained of doubtful validity. In the full realization of the 
inadequacy of such a measure as a criterion, the desirability 
of having it seemed of such advantage in the present study 
that it was decided to make an attempt to secure it. Hence, a 
second criterion is used ; i. e., a comparison between the 
growth in teaching skill of the student teachers of the experi- 
mental and control classes as measured by the difference be- 
tween their ratings at the beginning and at the end of their 
student teaching periods. 

Again, as in the case of the growth in the ability of the chil- 
dren, the effect of the training or the absence of training in 
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the use of standard test results in their teaching may be ob- 
scured by the operation of other factors. Again, therefore, as 
in the case of the factors operating to influence the progress 
of the children, a measure of the relative influence of every 
such factor which the circumstances surrounding the experi- 
ment rendered possible of measurement, was secured. 

It is important that the differences between the two criteria 
used be kept in mind. The first, the growth of the student 
teacher as measured by the growth of the children, is specific 
and objective. The second, the growth in teaching skill of 
the student teacher as observable in the classroom, is general 
and subjective. These differences establish, from the point of 
view of validity, the relative importance of the two criteria. 
The first is, of course, the more valid, and, hence, more weight 
will be given to the significance of the results as measured 
by it. 

3. THE PLAN 

In brief, the solution of the problem required : 

1. Equated experimental and control groups of children 
and student teachers. 

2. Batteries of standard tests given to the children, one 
form at the beginning and another form at the end of the 
experiment. 

3. Rating of the student teachers at the beginning and at 
the end of the experiment. 

4. Comparison of the growth made by the two groups of 
children, experimental and control, as judged by the differ- 
ence between the results of the first and second batteries of 
tests for the two groups. 

5. Comparison of the growth made by the two groups of 
students, experimental and control, as judged by the differ- 
ence between the two ratings of their teaching. 

6. Measurement of all possible variables that may have 
affected the results of the experiment, such as the mental and 
chronological ages of the children and of the student teachers. 



CHAPTER III 
The Conditions 

1. THE EXPERIMENTAL SITUATION 

The experiment was conducted in tw'enty-three practice 
classes connected with The Maryland State Normal School 
at Towson. Three distinct tj^pes of schools were involved: 
the city graded school, the rural one-or-two room school, and 
the elementary school on the normal school campus. There 
were 12 classes in Baltimore City located in 5 different schools 
in 5 different sections of the city; 8 classes in Baltimore 
County located in 6 one-or-two-room schools in 6 different 
sections of Baltimore County; 3 classes in the elementary 
school on the normal school campus. In the city, the 12 classes 
consisted of 4 each of Grades 3. 4, and 5. In the county, there 
were 2 third-grade groups and 6 combined 4th and Sth grade 
groups. In the campus school there was i class each of 
Grades 3, 4. and 5. 

While the 5 city schools used are located in different 
sections of Baltimore, the conditions are similar in so far as 
the jjopulation of each of the neighborhoods of these schools 
consists, for the most part, of typical city workers. In no 
case is there an appreciable foreign element, nor are the ex- 
tremes of economic background represented. The 6 schools 
in Baltimore County are in neighborhoods of small farms, 
the population consisting for the most part of farmers, but 
including, especially in the case of one school neighborhood, 
mill workers and mechanics. The campus school population 
represents the better type of suburban life, with rather more 
favorable economic background than is found in the other 
schools represented. 

In the city schools, two classes of the same grade were in 
charge of one teacher of practice who divided her time be- 
tween the two classes, teaching part of the time but spending 
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the greater part of the clay in supervision of student teachers/ 
In the county schools and in the campus school, the teacher 
of practice has but one classroom in charge. In each situa- 
tion — city, county and campus — there is a director of prac- 
tice, in the case of the campus school the function of the 
director of practice being vested in the principal of the school. 

The total numbers of pupils in these classes were as follows : 



Pupils 

12 city classes 

490 

8 county classes 

170 

3 campus classes 

83 

Total 

743 


Apportionment of Time Used in Experiment. — ^The Mary- 
land State Normal School at Towson is organized on a tri- 
mester basis, each term consisting of 12 weeks. The experi- 
ment was so planned that the first term was used for giving 
the necessary tests to the children in the practice classes and 
to the students involved and for studying the results of this 
testing. The experimental teaching was conducted during the 
2nd and 3rd terms, thus involving two different groups of 
student teachers. 

The Testing Program: Elementary Pupils. — ^The testing 
program of the children included 7 achievement tests and 2 
intelligence tests. 

The tests given in Octolier and November, 1924, were as 
follows : 

Intelligence ; 

Mentimeter School Group 2A 
Illinois Examination I Form i 

Achievement : 

Reading 

Thorndike McCall Reading Scale, Form i 

Stanford Achievement Test Form A: Test 3 — ^Word Meaning; 

Test 2 — Sentence Meaning; Test i — Paragraph Meaning 
Monroe’s Standardized Silent Reading Test Revised, Test l. 
Form I 
Spelling 

Morrison McCall Spelling Test, Form i 
Stanford Achievement, Form A, Test 6 (Primary) or Test 9 
(Advanced) 


‘This condition has since been changed, the teacher of practice in 
the city now being responsible for but one room as in the rural 
practice classes. 
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Arithmetic Problem Solution 

The Buckingham Scale for Problems in Arithmetic, Form i 
The Stanford Achievement Test Form A, Test 5 
Arithmetic Calculation 
Monroe Survey Scale in Arithmetic l 
Stanford Achievement Test Form A, Test 4 
Courtis Cleveland Survey 

In the final testing, the intelligence tests were omitted. 
Otherwise, the achievement tests were repeated in other forms 
with the exception of the Courtis Cleveland Survey which 
exists in but one form. Form 4 was used of the Thorndike 
McCall Reading and the Morrison McCall Spelling. In other 
cases, the second form of the test was used. 

To assure uniform results, the experimenter attempted to 
give all of the fall tests herself. This meant spreading the 
testing program over a period of two months. It was found 
necessary toward the end of the program to use the assistance 
of two trained workers besides in order to prevent invalidat- 
ing the results through an unduly prolonged testing period. 
Care was taken to give all of one type test within a week in 
order to minimize the difference in the results obtained due 
to spread of time. The scoring of these tests was made a part 
of the regular work in the courses in Tests and Measurements 
but again the amount of work involved was beyond the possi- 
bility of such treatment and other assistance had to be em- 
ployed. In either case, the tests were scored twice, the experi- 
menter making the final check wherever discrepancies 
occurred. 

In order to carry the experimental teaching as late into the 
spring as possible, it was found necessary to abandon the 
original plan of having all of the testing done by the experi- 
menter. Instead, the experimenter instructed a member of the 
faculty in each city school — in each case the member selected 
having had courses in tests and measurements and other ex- 
perience in testing — ^in giving the specific tests involved. 
This faculty member then gave all of the tests in the classes 
used in the experiment in her school. This plan insured dis- 
interested testers, for none had had any contact with the 
experiment. The tests in the county schools and in the campus 
school were given by the instructor in tests and measurements 
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at the Normal School, his assistant, the two directors of prac- 
tice, and a trained member of the Normal School staff. 

The Testing Program : Normal School Students. — One 
test, the I. E. R. Intelligence Test, was given to the students. 
The giving of this test occupied two full mornings, or ap- 
proximately seven hours. The experimenter instructed mem- 
bers of the staff experienced in testing work in the giving of 
the test. These instructors gave the tests to the fifteen .sec-- 
tions comprising the senior class, each part of the test being 
given at the same time and, in so far as it is possible to do so 
where different personalities are involved, in the same way. 
The scoring was done for the most part by volunteer faculty 
and student help. It was not possible to score every test twice 
as was done with the tests given to the children. Instead, a 
random sampling of each set of tests was checked and in 
cases where errors were found, the entire set was rescored. 

2. GENERAL STATUS OF THE PUPILS: MENTAL, 
CHRONOLOGICAL, AND EDUCATIONAL AGES 

Although through equating the groups, through change of 
classes, through leaving school and through other causes, the 
numbers in the course of the experiment were greatly re- 
duced, and, therefore, the status of the groups as reported 
in this chapter does not represent the status of the groups 
which persisted throughout the experiment, the general status 
of the groups as indicated by mental, chronological, and edu- 
cational ages will, nevertheless, be reported here. This is 
done because, although no measure of its influence is as yet 
available, it seems reasonable to assume that the intelligence 
and achievement of the group of which an individual is a part 
does help determine his success. The data are here offered in 
the hope that in them some further hypotheses might be 
found for pursuing further the search for the causes of 
school progress in which broad field the present study is laid. 

Attempt has been made in Figure 2 to bring together the 
educational, the mental, and the chronological ages of the 
pupils in the three types of schools — campus, city and rural — 
so that the relationships among these three ages and the like- 
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nesses and dif¥erences among their relationships in these 
schools might be clearly seen. The average mental age was 
computed by averaging the mental ages of the Trahue Menti- 
meter and of the Illinois Intelligence Examination for each 
pupil and then averaging these averages by grades. The edu- 
cational ages are the equivalents of the scores made on the 
Stanford Achievement Test. In order to establish a basis for 
comparison, the upper and lower limits of normal chronologi- 
cal ages at entering Grades 3, 4. and 5, according to the 
Strayer-Englehardt Computation Table, are shown in Fig- 
ure 2. The averages for the mental, educational .and chrono- 
logical ages for the three grades of the three types of schools 
are as follows ; 


Grade 3-I 


Campus 

'M. A. 1 1 1.8 mos. 
C. A. 107.2 
.E. A. III.8 
(23 pupils) 


Rural 

M. A. 99.5 mos. 
C. A. 1 12.5 
E. A. 108.9 
(23 pupils) 


City 

M. A. 93.05 mos. 
C. A. 106.4 
E. A. 106.S 
(iS 9 pupils) 


I'M. A. 126.3 nios. 
Grade 4-I C. A. 113.8 
LE. a. 126.5 

(29 pupils) 


M. A. 117.8 mos. 
C. A. 126.4 
E. A. 124.7 
(86 pupils) 


M. A. 1 12.3 mos. 
C. A. 1 16.8 
E. A. 120.2 
(175 pupils) 


fM. A. 148.1 mos. 
Grade 5-I C. A. 122.5 
LE. A. 137.9 
(29 pupils) 


M. A. 130.9 mos. 
C. A. 143.5 
E. A. 137.2 
(61 pupils) 


M. A. 130.6 mos. 
C. A. 133.8 
E. A. 134.3 
(156 pupils) 


The three groups of schools present three different condi- 
tions. In the campus school, the average chronological age 
for each grade lies about the upper normal age limit for 
entering the grade, while both the average mental and edu- 
cational ages exceed the chronological age. Here, then, is a 
school situation in which the pupils, on the average, have 
superior capacity and in the third and fourth grades are 
achieving in accordance with that capacity, though in the 
fifth grade the achievement, while still high as compared with 
chronological age, is not so high as the capacity. 

In the rural schools, the average chronological age in each 
grade exceeds the upper limit of the normal chronological age 
for entering the grade. The average mental age, on the con- 
trary, lies about the upper limits of the normal chronelogical 
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•••••■“ Upperand Lower limit? of noriTxil Chronoloqicol aqe 
at entering a grade. (Stroyer a Englehardt) 

Figure 2. — Average mental age, educational age and chronological age of 83 campus, 

170 rural and 490 city pupils. Total 743 in grades 3, 4, and S. 





24 


THE CONDITIONS 


age for entering the grade. The educational age exceeds the 
mental age but does not reach the chronological age levels. 
Here, then, is a situation where achievement exceeds capacity, 
but where neither capacity nor achievement reaches the 
chronological age averages. 

In the city schools, the average chronological age cor- 
responds to the upper normal chronological age limit for 
entering the grades. The average mental age is lower than 
the average chronological age but lies within the normal 
chronological age limits for the grades. The average educa- 
tional age exceeds both the average mental and chronological 
ages. Here, then, capacity levels are below chronological 
levels, but achievement levels are higher than either. 

In comparing the three groups, it is seen that the average 
chronological age of the third and fourth grades campus and 
city schools are approximately the same but that the fifth 
grade average of the city group is considerably higher than 
the fifth grade average in the campus school. The average 
chronological age in the rural schools is appreciably higher 
in each grade than in either of the other groups. 

In mental age, the averages in the third and fourth grades 
are lower in the city school than in either the rural or the 
campus schools while the fifth grade city and rural are ap- 
proximately the same. The average mental age in the campus 
school is as appreciably higher than it is in the other two 
groups of schools as is the average chronological age lower. 

While there are these diversities among the three groups in 
average chronological and mental ages, there is no correspond- 
ing diversity in average educational age. In other words, the 
three groups of schools differ but little in average achieve- 
ment but have reached such achievement status at different 
average ages and with different average mental capacity. The 
children in the campus school have reached the achievement 
indicated at a comparatively rarly age with high mental equip- 
ment ; the children in the rural schools, at a much later age 
with less mental equipment reach approximately the same 
achievement status, a status which, however, is still not equal 
to their average chronological age; the pupils of the city 
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schools at an average chronological age less than that of the 
pupils of the rural schools, with a correspondingly lower 
average mental age, reach approximately the same average 
achievement age, an age higher than the average chronological 
age. 

While these data are presented in terms of averages only 
and, therefore, give but a rough estimate of the relative con- 
ditions in the three situations, the widely different conditions 
in these fundamental factors should be kept in mind in inter- 
preting the results of the present experiment. If growth, for 
instance, has proceeded at such different rates as these sug- 
gest it is reasonable to expect different results in the three 
situations in the present experiment. 

3. GENERAL STATUS OF THE STUDENT TEACHERS AS INDICATED 
BY THEIR PREVIOUS TRAINING, SEX, INTELLIGENCE 
RATING, AND CHRONOLOGICAL AGE 

Numbers Participating in the Experiment. — In all, 158 
students of the senior class, which numbered 494, partici- 
pated in the experiment. As stated above, the experimental 
teaching was confined to the second and third terms of the 
school year 1924-25. The 158 students participating were 
distributed as follows : 


Second Term; 


Third Term: 


City Qasses 

42 

City Classes 

36 

Rural Classes 

20 

Rural Classes 

23 

Campus Qasses 

17 

Campus Classes 

20 


79 


79 


In the middle of each term, the rural and campus school 
students were shifted in order to give them at least two ex- 
periences during their student teaching, the students who 
began their student teaching in the campus school going to 
the rural centers and those beginning in the rural classes 
going to the campus school. Such shift was also made among 
the city students during the second term but it was not made 
during the third term. The numbers given above are for the 
beginning of each term. Some losses, incurred during each 
term, will be accounted for in Chapter IV. 
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The previous training of the students varied as follows : 

Of the 8o students in the rural group (those teaching in rural and 
campus classes) : 

74 attended 39 different high schools within the state, the 
greatest number attending any one high school being 7. 

3 attended private institutions within the state. 

3 attended institutions without the state. 

Of the 78 students in the city group : 

47 attended one of the two girls’ high schools in the city. 

21 attended the other of the two girls’ high schools in the city. 

6 attended other preparatory schools within the state. 

4 attended institutions without the state. 

Of the 158 students, 155 were women and 3 were men, a 
somewhat smaller proportion of men than in the entire class. 

The I. E. R. Intelligence Examination was given to the 
senior class at the Maryland State Normal School at Towson 
on November 19 and 20, 1924. The complete distribution as 
well as the distribution of the students participating in the 
experiment is shown in Figure 3. The intelligence records of 
3 of these students were lacking; hence the distribution is 
given for 155 students instead of the complete number, 158. 
It will be noted that the distribution of the scores of the group 
in the experiment is almost identical with that of the distri- 
bution of the scores of the entire class. This identity is the 
effect of chance distribution since other considerations enter- 
ing into the placing of the students in the classes used in the 
experiment made selection impossible. 

Figures 4 and 5 show the distribution of scores of the 
county and city groups respectively. The striking difference 
between the two groups might be of significance in the results 
of the experiment and should be borne in mind. Why the city 
group should score so much higher than the rural group is a 
matter of interest but not of importance to the present study, 
but the fact that these two groups do differ so widely is of 
importance in weighing the results of the experiment. 

Figures 6 and 7 show the distribution of the two groups of 
students participating in the experiment during the second 
and third terms. The groups taken as a whole average ap- 
proximately the same but the group of the third term is more 
variable, Qi being considerably lower and Q3 considerably 
higher than the correspondii^ points in the second term 
group. 
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Figure 3. — Distribution of I. E. R. Intelligence Score of the 155 
student subjects of the experiment compared with the distribution of 
entire senior class — ^464 in number. 

The numbers appearing in the distributions in Figures 3 to lO are 
key designations to particular individuals in the respecfive groups. 
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senior class — 464 in number. 
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Figuke 7. — Distribution of I. E. R. Intelligence Scores of 36 dty 
student subjects and of 42 rural student subjects during the third 
term_ of student teaching compared with each other and with the 
distribution of the total class. 
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The greater variability of the third term group is not due, 
however, to greater variability within the rural and the city 
groups taken as units. On the contrary, each of these groups, 
the rural group particularly so. shows less variability. The 
difference is due to the fact that the rural group teaching 
during the third term scored on the average lower and the 
city group higher than those teaching in the second term. 
While in each term the entire distribution of the student sub- 
jects of the experiment corresponds to the distribution of the 
entire class, and, therefore, can be considered a typical group, 
neither the rural nor the city groups as such can be considered 
typical of the class as a whole, the rural averaging lower and 
the city higher — particularly in the third term — than the 
class as a whole. 

The age distribution of the student subjects of the experi- 
ment as compared with the age distribution of the entire 
class is shown in Figure 8. It is seen from this figure that 
the age distribution of the student subjects of the experiment 
is similar to that of the age distribution for the entire class. 

Figures 9 and 10 show the age distributions for the rural 
and city student subjects of the experiment. The third quar- 
tile point is a year higher than that of the city group due 
mainly to the presence in the rural group of a number of 
experienced teachers, who after teaching in the state come 
to the State Normal School to complete the preparation which 
will entitle them to first-class state certificates. It was 
thought that the superior scores of the city students in the 
I. E. R. Intelligence Test might be due to the greater maturity 
of these students since the elementary and high school course 
is an 1 1 -year course in the state and a 12-year course in the 
city. The year less of preparation does not seem, however, 
to have brought with it a corresponding decrease of a year 
in average age. Again, as in the case of the intelligence test 
results, a field for further inquiry is suggested but will not be 
pursued further here. 

It was desired to make comparison of the scholarship dur- 
ing the junior year of the rural and city groups but it was 
practically impossible to do this with any degree of accuracy. 
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The experiment was conducted during the year that the 
merger between the Baltimore City Training^ School and the 
Maryland State Normal School was effected. Since, there- 
fore, the records of the junior year of the student subjects 
of the experiment had been made in different situations and 



Figure 8. — Distribution of the chronological ages of the 158 student 
subjects of the experiment compared with the distribution of the 
entire senior class— 464 in number. 


were made according to entirely different marking, systems, 
the results would not have been comparable. 

The status of the student teachers may be summarized from 
the foregoing as follows : 

I. The experiment was conducted during the second and 
third terms of the year 1924-25 involving 79 student teachers 
in each term. 
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of the rural group. 



THE CONDITIONS 


35 



City 


Figure io. — D istribution of chronological ages of 77 student subjects 
of the city group. 
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2. The distribution of intelligence scores of the entire 
group participating in the experiment is typical of the distri- 
bution of the entire class. 

3. The city group represents more homogeneous training 
than the rural group. 

4. The city students rank higher in intelligence scores than 
the rural students, the difference being greater in the third 
term than in the second. 

5. The average and the lowest quartile point in the chrono- 
logical age distribution are the same for the rural and city 
groups, but the rural group included a few older teachers 
which made the third quartile point a year higher in that 
group. 

6. The chronological age distribution of the group par- 
ticipating in the experiment is typical of the distribution of 
the entire class. 



CHAPTER IV 
Equating the Classes 

I. WHEN EQUATED 


The classes were equated twice : first, at the beginning, and 
second, at the end of the experimental teaching period. The 
groups were equated in the beginning primarily to lessen, as 
far as possible, the loss of cases that would necessarily be 
sustained in the final equating. Equating at the beginning had 
the additional advantage of securing two groups which might 
be expected, if all conditions in these groups were kept as 
uniform as possible, to progress at approximately equal rate. 
The two groups were equated in the end in order to secure 
two groups of equal initial status in each of the subjects in 
which experimental teaching was done in order to measure 
as accurately as possible the relative progress which the ex- 
perimental and control groups made in these subjects. 

2. EQUATING AT THE BEGINNING OF THE EXPERIMENT 

The three groups of schools used, city, rural, and campus, 
presented three different problems in equating. In the city 
schools, where two classes of the same grade were in charge 
of one teacher of practice, these two classes were reorgan- 
ized into equivalent classes. At The Maryland State Normal 
Elementary School, where one class only was in charge of a 
teacher of practice, each of the three classes used was divided 
into two equivalent groups. In the rural schools, the groups 
were too small to permit of the division of a single class into 
two groups; neither was it possible, since the schools were 
located in different neighborhoods, to secure equality by 
shifting the children from one school to another as they were 
shifted from one class to another in the city schools. The 
best that could be done was to match three of the six rural 
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schools against the remaining three, aiming to have the two 
pairs as nearly equal as possible. 

In the city and campus schools, each pair of experimental 
and control groups was under the supervision of the same 
teacher of practice; in the rural schools, under the supervi- 
sion of different teachers of practice. This condition intro- 
duced a variable into the rural situation which did not exist in 
the city and campus schools. Since the direct supervision of 
the experimental teaching was in charge of the teacher of 
practice, the importance of this variable looms large. When 
we add to the existence of this variable the condition described 
above, i. e., that no shifting from school to school to equate 
the groups could be carried out, it is apparent that conditions 
in the control and experimental classes in the rural situation 
were not so nearly equivalent as in the city and campus 
schools. 

Equating in the beginning in the city and campus schools, 
where it was possible to shift the pupils, was done mainly 
upon the basis of mental age. If, it was assumed, the main 
criterion in this experiment is the growth of the pupils along 
certain specific lines, then the control and experimental 
groups will be started with most nearly equal chances for 
success if the groups are equivalent in capacity. It was 
further assumed that the best measure of capacity available 
was the mental age of the pupils. When, however, equating 
upon this basis gave marked discrepancies, first, in chrono- 
logical age and, second, in educational age, further shifting 
was done upon these two bases successively. Finally, when 
shifting upon these bases left a preponderance of one sex or 
another in either group, further shifting was made to equal- 
ize this condition. In all of the shifting done, care was taken 
to maintain the original balance of the two groups in mental 
age. In each case, the central tendency as expressed by the 
arithmetic mean and the variability as expressed by S. D. were 
considered. The status of the experimental and control groups 
in mental, educational and chronological ages is shown in 
Table I. 
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TABLE I 

Mental, Educational, and Chbonolocical Ages (Mean and S. D.) 
OF Experimental and Control Classes After Initial Equating - 


Experimental Control 


Class 

Cases 

Mean 

S. D. Cases 

Mean 

S.D. 




MENTAL AGE 







City Classes 




A 

42 

92.0 

1 1.6 

42 

91.7 

II. I 

B 

35 

93-8 

114 

35 

94-1 

9-9 

C 

37 

109.0 

14.0 

38 

109.1 

17.4 

D 

48 

1 14- 1 

IS-I 

49 

115.3 

11.2 

E 

41 

129. 1 

133 

44 

128.3 

14.1 

F 

33 

133.2 

15.1 

34 

132.6 

14.7 



Campus Elementary Classes 



G 

13 

iii.i 

16.5 

12 

1 12.4 

13-5 

H 

IS 

124.3 

16.8 

14 

I 2 S -7 

iS -7 

I 

14 

150.0 

18.3 

IS 

149.4 

17.9 




Rural Classes 



JK 

35 

113-7 

16.2 

34 

113.I 

17-9 

L 

18 

122.8 

14-7 

12 

124.2 

194 

M 

33 

126.1 

18.3 

33 

1284 

14-5 



EDUCATIONAL ACE 






City Classes 




A 

37 

106.2 

9.7 

39 

105.8 

8.7 

B 

28 

107.4 

9-7 

28 

107.2 

8.5 

C 

31 

120.4 

7.2 

34 

122.3 

6.4 

D 

45 

119.6 

8.1 

47 

1 19.2 


E 

38 

132.3 

7-7 

42 

133.0 

8.4 

F 

27 

135.0 

ia3 

25 

137.6 

ll.i 




Campus Classes 



G 

7 

109.5 

U 

9 

113.6 

9.9 

H 

13 

127.4 

16.5 

13 

125.6 

13.5 

I 

13 

137.6 

1 1.4 

13 

136.7 

8.6 




Rural Classes 



JK 

26 

126.5 

I6.I 

22 

1 19.9 

13.1 

L 

IS 

126.1 

16.2 

18 

126.1 

14.1 

M 

30 

132.7 

II.O 

24 

134.S 

8.6 



CHRONOLOGICAL AGE 






City Classes 




A 

44 

1 10.3 

12.3 

44 

109.6 

12.2 

B 

36 

102.7 

5-5 

35 

101.7 

5.9 

C 

38 

119.2 

12.2 

39 

117-9 

12.3 

D 

49 

115.6 

9.6 

49 

nS-S 

9-5 

E 

42 

135.2 

1 1.6 

43 

137-6 

12.6 

F 

35 

129.S 

10.7 

36 

129.7 

11.2 


A 
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TABLE I . — Continued 
Experimental Control 


Clan 

Cases 

Mean 

S.D. 

Cases 

Mean 

S.D. 




Campus Classes 



G 

13 

108.3 

104 

12 

106.0 

7-3 

H 

15 

114.0 

II.l 

14 

117.7 

13-7 

I 

14 

121.1 

I7.I 

IS 

124.0 

134 




Rural Classes 



JK 

3 S 

1310 

22.8 

36 

131.8 

21.6 

L 

18 

132.1 

16.4 

13 

127.3 

17.7 

M 

33 

134-0 

21.7 

35 

132.8 

14-3 


3. EQUATING AT THE END OF THE EXPERIMENT 
Equating at the end of the experiment was made primarily 
upon the basis of initial status in the various achievement 
tests given. Since the main criterion of the experiment is the 
growth made by the two groups in spelling, arithmetic, and 
reading, it was of the utmost importance that the initial status 
of the pupils in the tests measuring these subjects be clearly 
established. It was difficult to establish this status in the pres- 
ent instance because of the unusually large loss of cases. This 
was due to several conditions. First, it had been decided, for 
the sake of greater reliability of results, that the experimenter 
herself should give all tests. This meant a long period of 
testing and a consequent shortening of the time allotted to 
the experiment. The experimenter could not go back to the 
schools to test absentees without further shortening of the 
time of the experiment. Attempt was made to have the train- 
ing teachers do this extra testing, but with the many demands 
made upon them this was often impossible. Hence, at the 
beginning many cases were lost. At the end, in order to con- 
tinue the experiment as long as possible, the testing program 
was given just before the close of the term. This meant a 
further loss of cases among children, particularly in the rural 
districts, who leave school early to work in the summer. 
Furthermore, the city schools have mid-year promotions when 
pupils had to be removed from and others had to be brought 
in to the classes used in this experiment. In the light of this 
experience, it would have been far better to have had the 
initial tests given by several testers simultaneously with the 
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opportunity thus afforded for the testing of absentees and the 
longer experimental period. The method had to be used in 
the end. It would have been better to have used it in the begin- 
ning also. 

With the loss of cases in mind, it was decided that the final 
equating should be made in two ways : 

1. The groups should be equated on the basis of each of 
the three reading measures, the two spelling measures, the 
two measures of arithmetic reasoning, and the three measures 
of arithmetic calculation. 

2. The groups should be equated on the basis of composite 
scores of the tests in reading comprehension, in spelling, in 
arithmetic reasoning, and in arithmetic calculation. 

The first method has the advantage of retaining a com- 
paratively large number of cases, but the results as expressed 
by any single test cannot be considered of much reliability. 
The second method provides for a compact, summary mea- 
sure of growth in each of the four subjects and gives much 
more reliable results, but it has the disadvantage of retaining 
a smaller number of cases. 

Equating According to Separate Tests. — In every case, 
extreme scores were eliminated and each score in the experi- 
mental group matched approximately with a score in the con- 
trol group so that the average, range, and standard deviations 
of each pair of experimental and control classes are almost 
identical.* Table II shows the results when pupils are com- 
bined, regardless of the type of school in which the classes 
were located, into grades. Table III shows the results when 
pupils are combined, regardless of grade, according to the 
school in which the classes were located. These two combi- 
nations were made, not only for the advantages of the larger 
number of cases thus obtained, but also that differences in 
results either in types of schools — campus, city, or rural — or 
in the grades might be brought out clearly and, in so far as 
possible, accounted for in the light of conditions existing in 
one situation or another. 

' The original data for the classes taken individually are on file in the 
library of The Johns Hopkins University. 
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TABLE II 

Experimental and Control Groups Equated by Grades — 3, 4, and 
S — Initial Status in Reading, Arithmetic and Spelling 

Experimental Control 

Caiei Range Av. S.U. Cases Range Av. S. D. Test 

GRADE 3 


Reading 


66 

78-133 105.30 

12.55 

66 

78-133 105.30 

12.55 

Stanford 

70 

22-59 

6.80 

6.80 

70 

22-57 

36.1s 

7-7o| 

’ Thorndike 
McCall 

S6 

0-9 

248 

2.48 

S6 

0-9 

5-43 

2.50 

Monroe 




Arithmetic Calculation 



69 

1.6-15 

9.20 

3-72 

69 

2.3-21.3 

9-9 

3.87 

Stanford 

62 

20-64 

44.40 

10. IS 

62 

20-64 

44-8 

9-40 

Monroe 

SO 

0-39 

20.05 

8.05 

SO 

6-31 

19-os 

7.1S 

Courtis 




Arithmetic Problems 



62 

0-44 

29-35 

11.60 

62 

0-45 

30.70 

12.00 

Buckingham 

60 

0—^ 

26.75 

10.40 

60 

0-48 

27.10 

10.30 

Stanford 





Spelling 




72 

2-25 

12.81 

4.1 1 

72 

2-23 

13.14 

4.14 

Morrison 

57 

6-82 

46.15 

14-50 

57 

6-78 

46.15 

14.00 

Stanford 


Grade 4 
Reading 

80 97-137 123.00 11.7s 80 ^157 123.25 10.00 Stanford 

89 29-55 39-65 S-SS 89 26-SS 39-90 5.40 Thorndike 

72 3-12 8.23 2.72 72 3-13 8.12 2.76 Monroe 

Arithmetic Calculation 

80 7-44.6 22.2 9.36 80 6.3-45.3 21.72 9.51 Stanford 

88 36-^ 70.5s 12.50 88 36-92 69.35 ia-90 Monroe 

86 6-92 51.25 21.80 86 8-81 51.48 20.95 Courtis 

Arithmetic Problems 

83 0-57 39-30 6.80 83 0-51 39.05 7.30 Buckingham 

87 8-72 39.80 12.50 87 8-80 40.40 12.45 Stanford 

Spelling 

86 7-38 19-59 6-93 86 4-36 19^5 6.81 Morrison 

83 22-104 63-70 17-20 83 26-120 64.40 18.35 Stanford 

Grade 5 
Reading 

61 107-172 139-80 13-25 61 109-173 138.95 12.35 Stanford 

84 27-59 44.10 6.40 84 26-57 44-50 S.45 Thorndike 

64 4-13 9-35 2.20 64 4-13 9.43 2.13 Monroe 
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TABLE II . — Continued 


Experimental Control 

A A 


Cases 

Range 

Av. 

S. D. Cases Range Av. 

Arithmetic Calculation 

S. D. 

Test 

8l 

17.1-67-5 

38.07 

i2.og 

81 13-3-69-5 

37-32 

11-49 

Stanford 

79 

52-116 

86.50 

12.20 

79 48-124 

87-50 

13-35 

Monroe 

71 

50-190 

gi.6o 

26.40 71 43-190 93-75 

Arithmetic Problems 

25.20 

Courtis 

79 

0-63 

49.70 

8-8s 

79 0-61 

48.8s 

8.80 

Buckingham 

75 

24-80 

55-20 

11.60 

75 24-88 

Spelling 

55-70 

12.20 

Stanford 

83 

15-40 

27-39 

6.51 

83 13-42 

27-78 

6.27 

Morrison 

69 

60-134 

88.20 

18.70 

69 30-138 

TABLE III 

87-45 

20.15 

Stanford 


Groups Equated at Close of Experiment, After Classes have 
BEEN Combined According to Type School — City, Campus, or 
Rural — Grades Disregarded, on Initial Status in Each 
Achievement Test, and After Elimination had been Made 
Because of Absence at One or Another of the Tests Given 
AND Because of Extreme Scores 


Experimental Control 

J A , < 


Cases 

Mean 

Range 

S.D. 

Cases Mean 

Range 

S. D. 

Test 





CITY CLASSES 







Reading 




158 119.90 

78-172 

18.80 

158 120.05 

72-173 

18.00 

Stanford 

170 

38.65 

22-59 

7-30 

170 38.60 

2^-57 

6.90 

Thorndike 

142 

7.09 

0-13 

3-02 

142 7.08 

0-13 

3.07 

Monroe 





Spelling 




152 

65-15 

6-134 

24-45 

152 64.4s 

6-138 

25.60 

Stanford 

177 

19.11 

2-40 

8.13 

177 19.08 

2-42 

7.89 

Morrison 




Arithmetic Calculation 



163 

66.25 

20-100 

ig.20 

163 66.35 

20-105 

19-30 

Stanford 

164 

22.41 

0-59 

14.22 

164 22.44 

0-61 

13.62 

Monroe 

133 

55-34 

7-149 

16.13 

133 55-63 

6-147 

14-95 

Courtis 




Arithmetic Problems 



154 

39.30 

4-80 

16.20 

154 39-60 

4-88 

16.3s 

Buckingham 

164 

36.85 

0-59 

12.05 

164 36.53 

0-61 

11-75 

Stanford 




CAMPUS CLASSES 







Reading 




27 130.45 

96-159 

18.0S 

27 128.25 

97-159 

16.90 

Stanford 

31 

44.10 

31-55 

6.8s 

31 44-60 

28-55 

7.00 

Thorndike 

19 

8.58 

1-13 

3.15 

19 8.37 

1-13 

3.05 

Monroe 
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TABLE III . — Continued 


Experimental Control 


Cases 

Mean 

Range 

S. D. 

Cases Mean 

Range 

S. D. 

Test 





Spelling 




28 

70.20 

30-116 24.73 

28 70.9s 

32-120 20.75 

Stanford 

31 

22.02 

7-36 

9.06 

31 22.32 

6-40 

8.88 

Morrison 




Arithmetic Calculation 



29 

74 - 4 S 

30-<ioo 22.05 

29 73.00 

20-100 22.15 

Stanford 

39 

24.99 

3-54 

13.29 

29 23.52 

3-51 

12.21 

Monroe 

33 

46.96 

5-112 13.34 

33 47.60 

10-98 

13.62 

Courtis 




Arithmetic Problems 



29 

44.00 

20-72 

16.3s 

29 45*85 

20-72 

13.25 

Buckingham 

30 

43.80 

0-57 

10.30 

30 44.00 

0-57 

11. 10 

Stanford 





BUAAL CLASSES 







Reading 




22 

123.50 109-146 

9.1s 

22 129.20 

112-158 

8.80 

Stanford 

41 

40.90 

28-53 

S.90 

41 41.30 

28-55 

6.60 

Thorndike 

31 

7.48 

3-1 1 

2.30 

31 7.32 

3-12 

2.34 

Monroe 





Spelling 




36 

79.60 

44-112 

20.90 

36 79.70 

44-110 

19.15 

Stanford 

33 

23.30 

9-36 

7^9 

33 25.68 

9-34 

6.51 

Morrison 




Arithmetic Calculation 



38 

76.70 

20-115 19.60 

38 77.10 

20-120 22.40 

Stanford 

39 

30.96 

0-63 

16.58 

39 31.95 

0-69 

17.76 

Monroe 

41 

74.80 

0-190 30.48 

41 71.53 

10-190 26.53 

Courtis 




Arithmetic Problems 



39 

46.3s 

20-80 

14.IS 

39 48.00 

16-84 

15.30 

Buckingham 

33 

43.00 

0-63 

10.93 

32 43.00 

o-6i 

10.93 

Stanford 





TOTAL CLASSES 







Reading 




207 

122.40 

78-172 18.40 

207 122.10 

72-173 

17.20 

Stanford 

242 

39-70 

22-59 

7.30 

242 39.90 

22-57 

7.40 

Thorndike 

192 

7.31 

a-13 

2.97 

192 7.25 

0-13 

2.9s 

Monroe 





Spelling 




216 

68.15 

6-138 23.75 

216 68.05 

6-134 24.50 

Stanford 

241 

20.13 

2-40 

8.25 

241 20.37 

2-42 

8.37 

Morrison 




Arithmetic Calculation 



230 

69.00 

20-115 20.40 

230 68.95 

20-120 20.65 

Stanford 

232 

23.32 

0-63 

14.76 

232 23.88 

0-69 

14.43 

Monroe 

207 

37.86 

o-igo 

19.87 

207 57.06 

6-190 17.7s 

Courtis 




Arithmetic Problems 



222 

41.50 

4-80 

16.20 

222 41.85 

4-88 

16.40 

Buckingham 

226 

40.4s 

0-63 

11.90 

226 40.20 

0-61 

11.70 

Stanford 
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Because of the large loss of cases sustained in compiling 
composite scores, it seemed futile to attempt the equation of 
individual classes. Instead, the classes were combined ac- 
cording to grade and then equated. Two main considerations 
entered into the problem of equating by grades : 

1. The method to be used in transmuting the scores of the 
various tests in each of the four subjects into comparable 
measures. 

2. The amount of weight to be given to the various trans- 
muted measures. 

1. Comparable Measures: Percentile Method. — The tests 
in each subject — reading, spelling, arithmetic calculation, and 
arithmetic problems — ^were combined to form a composite 
score. In each case, the scores were transmuted into age 
scores using the Stanford age for each subject as the basis 
for transmutation. The method used in reading in Grade 3 
will be described as an example : 

The Stanford reading ages for Grade 3 were plotted into 
a percentile curve. Likewise the Monroe Reading Scores 
and the Thorndike McCall T scores were plotted. The pairs 
of corresponding scores for the various percentile ranks for 
Standford and Thorndike McCall and for Stanford and 
Monroe, were then plotted and lines of relationship drawn. 
From the lines of relationship, tables of correspondence for 
Stanford and Thorndike McCall and for Stanford and Mon- 
roe were then made. It was possible to determine from these 
tables the scores in Monroe and Thorndike McCall equivalent 
to the Stanford Reading Age. The sum of the three scores 
then formed the unweighted composite reading score for 
each pupil.* 

2. Weighting. — ^The opinion of four experts in the field 
of educational measurements was sought in making the deci- 
sion as to the weight to assign to the various tests employed. 
In general, the opinion was in favor of giving more weight 
to the Stanford Achievement Test than to the other tests. In 

“Otis, Arthur S. Statistical Method in Educational Measurement, 
pp. 101-117. 
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the case of each test, an approximate average of the four 
weights was found and assigned as follows ; 


Stanford 

4 

3 

4 
4 


Reading 

Tborndike McCall* 

3 

1 

2 

2 


Monroe 

1.2 

I 

I 

I 


Approximate 4 
Average 


2 


Stanford 

I 

1 

2 
2 


Spelung 

Morrison McCall 
I 
1 
1 
I 


Approximate 2 i 

Average 

Arithmetic Calculatiok 

Stanford Monroe 

1 I 

2 I 

2 I 

2 I 


Approximate 2 i 

Average 


Arhhmetic Problems 


Stanford 

2 

2 

2 

2 


Buckingham 

3 

I 

1 

I 


Approximate 2 i 

Average 


1 


Courtis 


I 

I 

I 


The standing of the equated classes grouped by grades in 
terms of mean and S. D. is shown for the unweighted com- 
posite scores in Table IV. Table V gives the standing in the 
weighted scores when the classes are grouped according to 
grade. 

Attempt was made to equate according to type schools — 
city, campus, and rural — as was done in the case of the indi- 
vidual tests (Table III). The large variability found when 
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TABLE IV 

Grades Equated at Close of Experiment on Basis of Initial 
Status in Composite Scores in Reading, Spelling, Arithmetic 
Calculation, and Arithmetic Problems, Unweighted 


Experimental Control 



Cases 

Mean 

Range 

S. D. 

Cases 

Mean 

Range 

S.D.' 




READING 





Grade 

29 

3 I 4 - 8<5 

267 

28.4s 

29 

313-56 

264 

26.65 

3 



371 




368 


Grade 

39 

359-36 

308 

23.46 

39 

360-59 

307 

20.02 

4 



417 




417 

23.82 

Grade 

33 

4 IS- 6 o 

347 

26.50 

33 

413-12 

349 

S 



469 




470 





SPELLING 





Grade 

35 

89.0s 

53 

19.46 

35 

88.71 

53 

19.58 

3 



138 




136 

33.48 

Grade 

SI 

123,30 

72 

33-00 

SI 

122.86 

61 

4 



206 




214 


Grade 

43 

165.48 

1 18 

32.60 

43 

165-52 

1 17 

32.33 

S 



250 




253 




ARITHMETIC CALCULATION 



Grade 

27 

137-33 

109 

12.39 

27 

138.66 

108 

15-39 

^3 


208.07 

i6g 




170 


Grade 

- 40 

158 

24.4s 

40 

205.28 

154 

23.77 

4 



258 




252 


Grade 

37 

263.62 

214 

16.40 

37 

262.00 

215 

15.67 

5 



315 




306 




ARITHMETIC PROBLEMS 




Grade 

33 

SI-70 

20 

16.40 

33 

51.00 

23 

15.67 

3 


84 




80 


Grade 

57 

79-77 

28 

21.31 

57 

79.62 

34 

20.70 

4 



146 




154 


Grade 

55 

119-38 

82 

15-64 

55 

119-25 

86 

14-S1 

5 


170 




176 



TABLE V 

Comparison of Experimental and Control Situations — Grades 
Disregarded — in Initial Status in Composite Scores, 
Unweighted 


Experimental Control 


NoT 

Mean 

A — ^ 

Range S. D. 
READING 

'no. 

Mean 

Range 

S.D.' 

City 85 

361.31 

267 

452 

46.81 

81 

360.9s 

'll 

44.84 

M. S. N. II 

382.10 

30s 

469 

54-75 

12 

388.2s 

318 

470 

53-88 

Rural 6 

356.84 

3 w 

395 

3 M 1 

6 

360.25 

317 

386 

20.15 
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TABLE V.— Continued 


Experimental Control 



No. 

Mean 

Ran^e S. D. 

SPELLING 

No. 

Mean. 

Range 

S. tl. 

City 

98 

126.83 

53 4475 

265 

93 

122.68 

53 

261 

42.76 

M. S. N. 

19 

160.00 

S 9 75.32 

309 

18 

173.61 

89 

255 

45.35 

Rural 

12 

238.33 124 SS.88 18 200.56 

314 

ARITHMETIC CALCULATION 

124 

276 

39.03 

City 

76 

203.48 

109 53.56 

76 

198.77 

108 

302 

132 

287 

54.14 

M. S. N. 

19 

240.58 

304 

120 62.07 

350 

i6 

233.45 

38.46 

Rural 

9 

277.78 158 46.14 12 
327 

ARITHMETIC PROBLEMS 

236.92 

145 

306 

43.01 

City 

107 

79.82 

20 30.62 

147 

109 

84.36 

23 

176 

31.90 

M. S. N. 

22 

1 10.91 

35 39.49 

18 

105.78 

40 

26.62 

Rural 

16 

136.38 

I9I 

36 36.16 

21S 

18 

93.95 

139 

34 

154 

29.42 


several grades were considered in one grouping made equating 
impossible without reducing the already small number of 
cases to a point where no significance whatever could be at- 
tached to the results. On the other hand, because of the dif- 
ferences in the conditions under which the experiment was 
conducted, it seemed of importance to get some composite 
measure of the status of the three type groups in order that 
the results might be studied from the angle of the differences 
in the conditions of these groups. Accordingly, the status in 
the composite scores, unweighted and weighted, are presented 
in Tables V and VII respectively. No attempt at equating 
the groups was made, the scores of the pupils selected for 
equating by grade merely being redistributed according to 
type schools. 

While in the final equating initial status in the subjects 
whose gains in the experimental and control groups were to 
be compared was taken as the main basis for equating, mental 
age and chronological age were, as in the initial equating, also 
considered. The results are shown in Tables VIII and IX. 
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TABLE VI 

Grades Equated at Close of Experiment on Basis of Initial 
Status in Composite Scores in Reading, Spelling, Arithmetic 
Calculation and Arithmetic Problems, Weighted 

Experimental Control 

< “■ .A - , ■* ' V 

Caaea Mean Range S. D. Cases Mean Range S. D. 

reading; weight: Stanford — 4 ; monroe comprehension — i; 

THORNDIKE MCCALL — 2 


Grade 

29 

737-93 

591 

67.02 

29 

738.93 

613 

64.47 

3 

873 




862 

4 S- 8 i 

Grade 

39 

833.82 

712 

67.23 

39 

843-47 

744 

4 


1016 




960 


Grade 

33 

977-13 

830 

63.47 

39 

968.61 

826 

57-97 

5 

1112 




1108 


SPELLING : 

weight ; 

: STANFORD — 2 ; 

MORRISON MCCALL — I 

Grade 

35 

133.66 

77 

33-51 

35 

135.85 

89 

29.64 

3 



220 




208 


Grade 

SI 

183.23 

108 

310 

180 

50-47 

51 

185.49 

87 

31.20 

Grade 

43 

239-51 

52-35 

43 

262.28 


53-79 

S 



399 




387 


ARITHMETIC CALCULATION! WEIGHT! 

STANFORD — 2 ; 

COURTIS — I : 




MONROE — I 





Grade 

27 

184.63 

14s 

19.21 

27 

186.97 

144 

19.13 

3 



229 




226 


Grade 

40 

278.23 

217 

32.64 

40 

271-55 

194 

37-22 

4 



350 



348.89 

336 


Grade 

37 

350.14 

27s 

38.02 

37 

268 

35-75 

S 



4 IS 




402 


ARITHMETIC PROBLEMS ! 

weight: STANFORD — 2 ; BUCKINGHAM — I 

Grade 

33 

77.66 

24 

23.82 

33 

77.88 

35 

24-02 

3 



124 




124 

32.56 

Grade 

57 

119.10 

55 

33.60 

57 

119.94 

56 

4 



2i8 




234 


Grade 

55 

174-91 

II4 

26.16 

55 

176.49 

114 

24.99 

5 


250 




264 
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TABLE VII 

Comparison of Experimental and Control Situations — Grades 
Disregarded in Initial Status in Composite Scores, 
Weighted 


Experimental Control 



No. 

Mean 

Range 

S. D.’ 

No. 

Mean 

Range 

S.D.' 

READING ; 

: WEIGHT 

: STANFORD — 4 

; THORNDIKE 

MCCALL — 2 ; MONROE — ! 

City 

8s 

845.67 

591 

113.38 

81 

846.16 

613 

104.46 




1071 




1040 


M. S. 

N. 10 

920.60 

773 

122.27 

12 

010.17 

706 

127.44 



III 2 




1108 


Rural 

6 

844.67 

736 

69.58 

8 

849.13 

759 

42.98 




934 




904 


SPELLING : 

WEIGHT 

: STANFORD — 2 ; 

: MORRISON MCCALL- 

-I 

City 

98 

180.73 

77 

68.54 

93 

185.70 

87 

63.93 




399 




387 

69.63 

M. S. 

N. 19 

197.05 

91 

68.58 

19 

222.42 

89 




309 




375 

82.38 

Rural 

12 

230.34 

59 

71.83 

17 

217.12 

8S 


314 384 


ARITHMETIC CALCULATION: Y.HtGHT : STANFORD — 2 ; COURTIS — i; 





M-' 

\ROE — I 





City 

76 

271.18 

145 

408 

152 

408 

69.03 

76 

264.68 

144 

71.12 

M. S. N. 

19 

294.58 

78.1s 

16 

314.81 

402 

188 

387 

51.69 

Rural 

19 

317.33 

214 

41S 

61.37 

12 

311.08 

193 

402 

56.9s 

ARITHMETIC PROBLEMS: 

weight; STANFORD— 2; BUCKINGHAM — I 

City 

107 

10436 

24 

161 

27.68 

109 

126.21 

35 

264 

47.62 

M. S. N. 

22 

116.73 

59 

I9I 

31.57 

18 

153.23 

64 
21 1 

40.80 

Rural 

16 

160.62 

56 

250 

48.52 

18 

143.61 

S8 

234 

44.40 
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TABLE VIII 

Mental Age — Final Equating of Experimental and Control 
Group by Grades 


Experimental! Control 


f ' ' 

Cases 

A 

Meao 

S.D. 

Cases 

Mean 

s, d! 



GRADE 3 




Reading 29 

94.22 

10.75 

29 

96.60 


Arith. Cal. 27 

94-53 

13.20 

27 

96.57 

8.85 

Arith. Prob. 33 

94.01 

12.6s 

33 

95-23 

10.85 

Spelling 35 

91.64* 

12.90 

35 

95-64* 

14.25 



GRAi)E 4 




Reading 39 

120.58* 

11.20 

39 

111.99* 

ii-So 

Arith. Cal. 40 

117.05 

15-60 

40 

117.52 

14.00 

Arith. Prob. 57 

117.52 

rs-8s 

57 

117.47 

13.80 

Spelling $1 

1 17.3 1 

15-75 

SI 

117.50 

13.20 



GRADE 5 




Reading 33 

133-53 

13.90 

33 

134-46 

12.90 

Arith. Cal. 37 

133-83 

17.30 

37 

136.82 

14.60 

Arith. Prob. 35 

133-50 

16.40 

35 

137-32 

15.25 

Spelling 43 

134-70 

16.80 

43 

136.57 

14.40 


* Instances in which Equating is not close; See p. 5a 


TABLE IX 


Chronological Age — Final Equating of Experimental and 
Control Group by Grades 



Experimental 


Control 


Cases 

Mean 

s. d! 

Cases 

Mean 

s.d! 



GRADE 3 




Reading 29 

113.66 

12.45 

29 

113.36 

12.40 

Arith. Cal. 27 

102.74 

7-05 

27 

101.98 

7.0s 

Arith. Prob. 33 

113.83* 

9-75 

33 

108.04* 

8.40 

Spelling 35 

107.528 

9.60 

35 

107.81 

7.30 



GRADE 4 




Reading 39 

123.66 

10.05 

39 

123.60 

10.25 

Arith. Cal. 40 

111.15* 

11.40 

40 

117.10* 

It. 65 

Arith. Prob. 57 

111.728* 

22.25 

57 

1 17.413* 

9.8s 

Spelling 51 

1 17-54 

II.I5 

SI 

1 17.324 

11 . 2 $ 



GRADE 5 




Reading 33 

127.OS 

13-85 

33 

126.71 

12.50 

Arith. Cal. 37 

127.09 

15.15 

37 

125.96 

13-95 

Arith. Prob. 35 

127.12 

14.00 

35 

126.78 

12-50 

Spelling 43 

126.71 

13.70 

43 

126.34 

14-55 


* Instances in which Equating is not close ; See p. 52 
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In equating according to chronological age (Table IX), it 
will be noted that there are 3 cases in which the equating 
is not close (Note, Table IX). Since one of these favors 
the experimental and two favor the control, it was thought 
best to leave the discrepancy rather than destroy the equating 
according to initial status. 

Again, in equating for mental age there are two discrepan- 
cies (Note, Table VIII). Since, however, one of these again 
favors the experimental and the other favors the control 
group, it was thought best not to disturb the equating accord- 
ing to initial status. The more serious discrepancy is in the 
case of reading. Grade 4. In attempting to make a better 
equating, it was found that the discrepancy was due to one 
high mental age in the experimental and to one low mental 
age in the control. Removing these cases resulted in much 
better equating according to mental age : 

Experimental: 1 12.051 Mean; 12.00 S. D. 

Control: iii.8s Mean; 10.90 S. D. 

If this were done, however, the equating according to ini- 
tial status would not be so good, resulting in : 

Experimental: 831.81 Mean; 59.20 S. D. 

Control: 850.84 Mean; 45.00 S. D. 

in place of the original equating: 

Experimental: 835.532 Mean; 67.23 S. D. 

Control: 84347 Mean; 45.81 S. D. 

It was, therefore, decided not to attempt a closer equating 
according to mental age. 



CHAPTER V 


Equating Experimental and Control Groups of 
Student Tea.chers 

I. equating at the beginning of the experiment 

Attempt was made to equate the groups of student teach- 
ers at the beginning of the experiment. Ordinarily, assign- 
ment to training centers at the Maryland State Normal School 
at Towson is based primarily upon the student’s own choice 
of grade. Effort is also made to apportion strong and weak 
students in such a way that no training center will suffer the 
disadvantage of being overburdened with an undue number 
of the weaker students. Again, the personality of the stu- 
dent in relation to the personality of the teacher of practice 
is considered in order that students may be placed to the 
best advantage with respect to their individuality. Every 
effort was made to assign the students in such way as to 
equate the experimental and control groups and at the same 
time carry out the above policy. 

As will be shown in the tables, it was possible'to carry out 
the plan with fair success at the first assignment of the stu- 
dents at the beginning of each of the two terms. It is the 
custom, however, to shift the students at the end of the first 
half of the term in order to give them two teaching experi- 
ences. Here it was found to be impossible to preserve the 
original composition of the control group without serious 
injustice to the students. This resulted in the loss of certain 
of the students in the control group by transfers to training 
centers not included in the experiment and the substitution 
of students not in the original control groups. The original 
composition of the experimental groups was preserved even 
at a sacrifice, in some cases, of the best adjustment for the 
student. In the third term, for the sake of the experiment, no 
mid-term shift was made in the city experimental group. 
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CONTROL GROUPS OF STUDENT TEACHERS 


Every experimental student who persisted to the end of the 
experiment had a complete term of training in the method 
used in this experiment. 

The bases for equating the students were: Intelligence, 
Scholarship, Prognosis of Teaching Ability, and Age. Intelli- 
gence was measured by the I. E. R. Intelligence Test (Chap- 
ter III). Scholarship was measured by an average of all the 
grades of the junior year. A difficulty was encountered here 
in the different record systems used for the city and the 
county students, the city students having been marked during 
their junior year at the Baltimore City Training School on 
the o-ioo basis, while the county students had been marked 
on the 1-7 basis. This rendered an accurate comparison of 
the scholarship of the two groups of city and county students 
unsatisfactory but served the purpose of equating city experi- 
mental and control groups and county experimental and con- 
trol groups. Attempt was made to secure a purely subjective 
rating of prognosis of teaching success by three instructors 
who knew the students quite well. It was possible to secure 
this at the beginning of the two terms for the city students, 
but it was possible to secure it only at the beginning of the 
second term for students assigned to county training centers. 

Equating was carried out by matching as nearly as possible 
the students in an experimental center with its paired control 
center. In addition, effort was made to equalize the entire 
group of city experimental students with the entire group of 
city control students, the county experimental with the county 
control, and the campus experimental with the campus 
control.* 


2. EQUATING AT THE END OF THE EXPERIMENT 

The students were equated again at the end of the experi- 
ment in order to secure groups of more nearly equal initial 
status than it was possible to secure at the beginning of the 
experiment because of the other conditions entering into the 
assignment of the students indicated above. It was desired 

* Tables indicating the above equating of groups of student teachers 

are on file in tVie tihrarv of XfiP Inline WnnVinc TTnivereifv 
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to equate, also, on the basis of possible teaching ability as indi- 
cated by the teaching done by the student teachers during the 
first week of their student teaching period. 

In the summer previous to the beginning of this study a 
preliminary experiment had been performed for the pur- 
pose of selecting a good rating scheme to use in this phase 
of the work. In brief, the experiment consisted in the evalu- 
ation of the work of three demonstration teachers in each 
of three summer schools by groups of eight supervisors, 
superintendents and teachers. Each evaluator rated each 
teacher five times, the first rating being a purely subjective 
one and the other ratings made with the help of five represen- 
tative rating cards. The results showed that no greater uni- 
formity of rating of the same teachers by different evaluators 
was secured with the aid of rating cards than was secured on 
a purely subjective rating. No doubt, as Johnson has shown, 
greater uniformity of rating can be secured with the use of a 
rating card after a period of training of the evaluators.’ 
Since such training was impossible in the present experiment 
and since the limitations of time did not permit the rating of 
79 students by a sufficiently small group of evaluators to make 
such rating of significance, equating by initial rating was 
omitted. 

The students, then, were equated at the end of the experi- 
ment first, on the basis of the I. E. R. Intelligence Test, then 
according to scholarship, and finally according to chronological 
age, in each case extremes being eliminated. Since in the 
middle of each term, the campus students and the rural stu- 
dents are interchanged, these two groups were combined in 
equating. Tables X and XI show the equated experimental 
and control groups for city and combined campus and rural 
schools, respectively. 

‘Johnson, F. W. “Supervision of Instruction,” School Review, 
XXX, 1922 , pp. 742-754- 
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TABLE X 

Final Equating, Student Teachers in City Classes 


Experimental Control 


Student 

LE.R. 

Jutiior 

Chron. 

age 

Student 

I. E. R. 

Junior 

Chron. 

age 

key no. 

Intel. 

grades 

mo 9 . 

key no. 

Intel. 

grades 

mos. 

45 

226 

84 

218 

319 

446 

87 

216 

256 

3 H 

8s 

216 

46 

262 

80 

229 

309 

341 

86 

228 

252 

272 

80 

242 

288 

299 

86 

219 

242 

200 

83 

234 

61 

340 

8S 

233 

40 

284 

82 

217 

239 

417 

84 

221 

27 

271 

86 

233 

297 

258 

87 

231 

326 

307 

84 

22s 

272 

397 

86 

224 

62 

272 

88 

221 

283 

353 


217 

301 

287 

89 

247 

58 

398 

88 

237 

37 

340 

90 

208 

246 

288 

87 

194 

274 

377 

8S 

227 

312 

362 

88 

238 

260 

343 

86 

212 

63 

335 

86 

231 

49 

338 

80 

217 

39 

247 

8S 

239 

50 

225 

84 

246 

251 

281 

80 

248 

279 

367 

86 

227 

69 

464 

85 

235 

300 

300 

88 

235 

296 

392 

88 

207 

316 

351 

84 

227 

324 

260 

84 

22s 

237 

266 

87 

208 

248 

293 

82 

^37 

271 

337 

88 

229 

317 

388 

83 

224 

25s 

338 

84 

239 

65 

212 

81 

230 

250 

273 

87 

248 

328 

424 

87 

210 

78 

383 

85 

235 

249 

287 

74 

236 

303 

310 

85 

204 

238 

432 

88 

228 

48 

334 

81 

219 

72 

373 


219 

26s 

465 

89 

226 

327 

419 

8S 

210 

280 

373 

87 

204 

333 

375 

87 

207 

235 

363 

88 

241 

43 

221 

87 

244 

294 

499 

88 

243 

32s 

SIS 

94 

217 

313 

42s 

81 

225 

273 

337 

88 

267 

74 

370 

86 

226 

41 

399 

8s 

248 

57 

381 

88 

222 

Sum 

10646 

2656 

7036 


I 04 S 9 

2646 

7258 

Av. 

343-41 85.67 

226.96 

337-38 

85.35 

226.1 

S. D. 

73.93 2.29 

14.11 


66.31 

2.84 

18. ( 

Num. 

31 

31 

31 


31 

31 

31 
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TABLE XI 

Final Equating, Student Teachers in Campus and Rural 
Classes 


Experimental Control 


Student 

I.E. R. 

Junior 

Cbron. 

age 

Student 

I.E. R. 

Junior 

Chron. 

age 

key no. 

Intel. 

grades 

mas. 

key no. 

intel. j 

grades 

moS* 

4 S 6 

333 

* 

276 

129 

316 

4.8 

211 

125 

223 

4.5 

218 

397 

393 

5.6 

2 II 

i88 

226 

4.1 

225 

426 

266 

3.7 

214 

429 

227 

4.3 

216 

431 - 

341 

4.5 

224 

i6s 

28s 

4.6 

208 

398 

311 

4.5 

222 

447 

272 

* 

271 

407 

248 

4.7 

19s . 

433 

173 

3-7 

226 

4 t£ 

231 

3.8 

209 

164 

304 

4.4 

2 II 

427 

291 

4.1 

207 

374 

257 

3.4 

218 

416 

278 

4.5 

204 

460 

304 

* 

218 

142 

27s 

5.3 

207 

360 

322 

4.3 

229 

134 

198 

3.2 

224 

180 

199 

4.0 

214 

171 

196 

4.2 

199 

179 

240 

4.3 

243 

383 

316 

5.2 

213 

394 

371 

6.1 

216 

381 

221 

4.8 

214 

443 

215 

4.6 

214 

172 

167 

4.8 

222 

173 

300 

5.4 

227 

196 

225 

4.9 


18S 

236 

* 

284 

202 

156 

3.9 

208 

382 

307 

4.6 

226 

395 

373 

5.3 

204 

126 

283 

4.2 

283 

372 

344 

4.5 

207 

377 

342 

6.0 

223 

130 

200 

4.0 

238 

Sum 

5419 

72. 5 

4646 


5346 

91.1 

4228 

Av. 

270.9s 4-5 

232.30 


267.30 

4.5 

211.4 

S. D. 

51.35 -73 

24.37 


66.46 

1.96 

10.33 

Num. 

20 

16 

20 


20 

20 

20 


* No junior grades, because these students entered the Maryland State Normal 
School in their senior year. 



CHAPTER VI 

The Materials of the Experiment 
I. general plan 

The experiment was conducted during the second and third 
terms of the school year 1924-25. During the second term, 
nine weeks dating from January 5th to March 14th were 
used. During the third term, ten weeks dating from March 
i6th to May 23rd were used. While some procedures in the 
third term were different from some in the second term, the 
administration in both terms ^vas essentially the same. 

1. The experimenter met each of the three groups of stu- 
dents assigned to do the experimental teaching in the city, 
campus, and rural centers for the purpose of explaining the 
main features of the experiment. They were told that they 
would be given the results of standard tests previously given 
to the children in order that they might base their instruction 
in arithmetic calculation and problem solution, spelling, and 
reading upon such results ; that specific instructions would be 
sent them weekly in bulletin form; that they would keep 
diaries of their work in these subjects upon blanks sent to 
them; that their teachers of practice would guide them in 
this phase of their work as in other phases. No mention was 
made to them of the existence of a control group. On the 
contrary, every effort was made to prevent such knowledge 
from coming to them. 

2. Nine mimeographed bulletins in the second term and 
ten such bulletins in the third term were sent to each student, 
each bulletin indicating one week’s work to be carried out. 

3. Each week the students sent to the experimenter diaries 
of their work and any other material indicative of the chil- 
dren’s activities as called for by the bulletin. 

4. The experimenter made attempt to pay at least one visit 
to each student, but this was found to be impracticable. 

S8 
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5. More or less informal conferences were held between 
the experimenter and the teachers of practice on the progress 
of the work. 

The details will be treated separately for the two terms. 

2. EXPERIMENT DURING THE SECOND TERM 

According to the original plan as indicated in Chapter II, 
the time devoted to the experimental teaching was to be al- 
lotted as follows; 

3 30-minute periods per Week in reading 
3 is-minute periods per week in spelling 
3 30-minute periods per week in arithmetic, the time to 
be divided equally between arithmetic calculation and 
problem solution 

Because of the work involved in scoring the tests and tabu- 
lating and diagnosing the results, it was found impossible to 
launch the program in its entirety in the beginning. The 
changes made in the original plan will be indicated later. 
Copies of the instructions for keeping the diary of test- 
determined instruction, of the diary blank, of a sample score 
sheet sent to the experimental classes with Bulletin I, and of 
a sample of the suggestions for grouping the children in 
reading are found in the appendix (see C, D, E, and F).* 
Summaries of the nine bulletins sent during this term follow : 

Bulletin i dealt with reading. It set the problems for the 
week, indicated the amount of time to be used, assigned defi- 
nite phases of the work to the students, and gave suggestions 
of type material to be used. In addition, a score sheet of the 
initial test in reading, together with directions for grouping 
the children, was sent to each center (Appendix E). The 
score sheet gave each child’s score in the six reading mea- 
sures available, along with class norms for the preceding 
grade as well as for the grade which the children had reached 
at the time of the experiment. The particular types of work 
outlined in the bulletin suitable to the various groups of chil- 
dren were indicated. 

Bulletin 2 contained directions for starting the work in 
spelling. In addition to scoring the Morrison McCall Spelling 

’ Other samples of score sheets sent with the various bulletins are on 
file in the library of The Johns Hopkins University. 
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Test, given among the initial tests at the beginning of the 
school year, analysis of errors had been made on diagnostic 
score sheets. These diagnostic score sheets formed the basis 
for the selection of the words to be used in the spelling exer- 
cises given in the bulletin. With the bulletin, the scores made 
by each child in the Morrison McCall and the Stanford Spell- 
ing Tests and also a summary of the number of times each 
word of the Morrison McCall Test had been misspelled were 
sent to each experimental class. 

Bulletin 3 gave directions for the work in arithmetic cal- 
culation. The exercises for the week were based upon the 
results shown in the Courtis Arithmetic Test and were con- 
fined to addition. With this bulletin, scores for each child in 
the various tests given and also the detailed score sheet of 
the Courtis Test were sent. 

Bulletin 4 again dealt with reading. It reported to the stu- 
dents the results of the Jones Vocabulary Test which they 
had been asked to give in Bulletin i. This bulletin contained 
a summary of the results, an analysis of these results, sugges- 
tions for the use of phonics in the teaching of reading, and 
basic principles underlying the teaching of phonics. Aside 
from the work in phonics, reference was made to Bulletin i 
for suggestions as to other reading exercises to be given. 

Bulletin 5 is the second bulletin devoted to spelling. While 
the exercises suggested in Bulletin 2 were based upon the 
findings of the Morrison McCall Test, the exercises in Bulle- 
tin S included also the results of the class work carried out 
in compliance with Bulletin 2. A summary of the returns 
from all of the classes was given, indicating the number of 
times each word of the informal test had been misspelled in 
the first and the second times the test had been taken. Again, 
as in Bulletin 2, specific spelling difficulties were analyzed 
and measures to correct such difficulties were recommended. 

Bulletin 6. Until the close of the fifth week, each bulletin 
was devoted to one subject only — arithmetic calculation, spell- 
ing, or reading. With the beginning of the sixth week, this 
policy was changed. Reading and spelling were to be con- 
tinued, and corrective work in arithmetic problem solution 
was presented for the first time in Bulletin 6. The work in 
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arithmetic problem solution was based upon the analysis of 
the results of The Buckingham Scale for Problem Solution, 
a summary of which analysis was included in the bulletin. 

Bulletins 7 and 8. At this point, the student was left more 
to his own initiative in organizing his work, reference being 
made to bulletins sent previously from which he was to draw 
his material. Bulletins 7 and 8 gave general directions for 
conducting the work in the four subjects. 

Bulletin 9 outlined the testing program planned as a check 
on the work of the preceding eight weeks. 

Bulletins i and 5 are offered as samples of the work sum- 
marized above.* 


Bulletin i 

TEST-DETERMINED INSTRUCTION FOR EXPERIMENTAL PRACTICE CENTERS — 
GRADES 3, 4, 5 

Subject — Reading Number of periods 2 

Time — Week of Jan. s. IQZS Length of periods 30' 

Problems for week ; 

1. To rouse desire for improvement in reading. 

2. To make note of individual undesirable reading habits. 

3. To give Jones Vocabulary Test to children whose scores in the 
Stanford Vocabulary Test are below the class average. This test will 
help determine the specific vocabulary difficulties of these children and, 
thus, the types of vocabulary exercise to give them. 

4. To give one remedial exercise to group in need of work in sen- 
tence meaning and one remedial exercise to group in need of work in 
paragraph meaning. 

Organization of the work: 

1st period. 

Activity i. Rousing desire for improvement in reading. Present 
chart to children showing the distribution of their class scores. Let 
the children find their scores on the chart. Tell of the tests to be given 
in June. Emphasize the importance of the amount of growth made 
between the two tests rather than of the scores themselves. 

Activity 2. Study of undesirable reading habits. Assign a silent 
reading lesson to the class as a whole. Observe carefully the children 
who are below average in Monroe Reading (Comprehension) and_ in 
Vocabulary (see accompanying class list). Make note of the following 
undesirable reading habits : 

a. Pointing to words with fingers. 

b. Lip movement. 

c. Audible repetition of words. 

d. Screwing up face, shaking head, tugging at hair. 

Make note of the following undesirable study habits : 

a. Lack of concentration. 

b. Failure to get to work at once. 

c. Short duration of close attention. 


’ All other bulletins are on file in the library of The Johns Hopkins 
University. 
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The making of these observations will be facilitated if a seating 
chart of the class is prepared beforehand, the jottings being made 
immediately upon the chart. 

Activity 3. Giving of the Jones Vocabulary Test to children with 
poor vocabulary scores. While one student teacher is conducting 
Activity 2, the other two student teachers will give the Jones Vocabu- 
lary Test in accordance with directions. 

Summary : 

1. Presenting chart — Class scores. 

2. Children read silently. Student I makes observation while 
Students 2 and 3 give vocabulary test to children individually. 

2nd period. 

Activity l. Continuation of Jones Vocabulary Test. 

Activity 2. One student will give an exercise in sentence meaning 
and in paragraph meaning._ The group weak in vocabulary and the 
group not in need of remedial work will work at desks at an assigned 
reading exercise. 

Activity 3. One student will give an exercise in paragraph meaning, 
the organization of the class being the same as for Activity 2. 

Summary : 

Directed Undirected 

j. Testing Individuals 

2. Sentence Meaning Vocabulary Group 

3. Paragraph Meaning Non-Remedial Group 

Suggested Exercises for Remedial Work in Reading 

The exercises given below are suggested as types from which selec- 
tion may be made in carrying out the instructions in the bulletin. 


A. Exercises in Sentence Meaning 

I. Fes and no questions 

Lewis and Roland, 3rd Reader, pp. 27, 245 
Lewis and Roland, 4th Reader, p. 70 
Lewis and Roland, 5th Reader, p. 125 
Z Mixed Sentences 

Lewis and Roland, Sth Reader, p. 212 

3. Completions 

Maryland School Bulletin, March 1924, vol. II, No. ii, p. 20 
Elson Book, 3, p. 137 

Progressive Road to Reading, Book 2, p. 97 

4. Choosing the right word 

Lewis and Roland, Book 3, p. 69 

5. Choosing the right answer 

Lewis and Roland, Book 3, p. 97 

6. Following directions 

Lewis and Roland, Book 3, p. 161 
Lewis and Roland, Book 4, p. 174 
Lewis and Roland, Book $, p. 106 

7. True or false statements 

Lewis and Roland, Book 3, p. 179 
l.ewis and Roland, Book 4, pp. 99, 106 
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B. Exercises in Paragraph Meaning 

1. Acting a paragraph 

Lewis and Roland, Book 3, pp. 60, 204, 130, 199 
Lewis and Roland, Book 4, pp. 148, 25. 

2. Three types suggested in Md. School Bulletin, March, 1924, p. 35. 

a. “ Children read silently one paragraph of the lesson and then 
glance up. The teacher asks a pivotal question about the paragraph. 
This is continued throughout the selection.” (See also Every Day 
Classics, sth, pp. 278-284.) 

b. “ The teacher explains before the paragraph is read that the 
purpose of reading is to find the answers quickly. She then asks a 
question calling for some specific fact. As soon as a pupil can answer 
the question he raises his hand, or glances up at the teacher. This 
speeds up the slow reader.” 

c. “ The teacher asks the question before the paragraph is read. 
Whoever finds the answer may stand and read aloud the one sentence 
which contains the answer.” 

3. Let children read a paragraph and find the sentence that the 
paragraph tells about (Topic Sentence). 

4. Teacher writes sentence on board and asks children to guess 
what paragraph is about. Children then are directed to a certain pa^e 
and read the paragraph in order to determine how near right their 
guess was. 


C. Exercises for Children Not in Need of Remedial Work 

It is important that these children should be given such specific 
training as will lead them further in their reading appreciation and 
power. Give them definite assignments and check the results. 

1. Assignment in which definite questions on paragraph meaning 
are asked, when the answer is not found directly in the material but 
must be inferred. 

2. Working up individual reports on supplementary material in 
history, geography, or nature study and presenting such reports at the 
class recitations in those subjects. 

3. Preparation by the group of a dramatization to present to the 
class. 

4. The following material is recommended : 

a. Wheeler. 

b. Horn and Shields. 

c. Elson. 


D. Exercises in Vocabulary 

1. Forming a definite number of small words from a large word; 
e. g.. Form 12 words from Baltimore. 

2. Answering questions by selecting appropriate words. 

Maryland School Bulletin, March, 1924, p. 53. 

Bolenius, Fifth Reader, p. 122. 

3. Word pictures. 

Md. School Bulletin, March, 1924, p. 56. 

4. Practice in analysis of prefix, suffix, and root. 

Md. School Bulletin, March, 1924, P- SS- 
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Bulletin s 

test-determined instruction for experimental practice centers — 

GRADES 3, 4, S 

Subject — Spelling Time — Week of February g — City 

Week of February i6 — County 
The experimenter wishes to express her appr^iation of the very 
fine way in which returns from the remedial teaching are being sent in. 
They are good both in content and in form. The latter is of the utmost 
importance in this work, for such attention as you are giving to little 
details facilitates the work of tabulation. Remember, please, to identify 
clearly every paper that you send in: name of school, grade, date, 
your name. 


Spelling 

Time — ^3 15' periods 

I. Bases of work for week ; 

1. Returns from informal tests that you have sent in. 

2. Needs shown in Morrison McCall Spelling Test. 

II. Problems for week; 

1. To strive for at least 5% greater accuracy in the words listed 
than was attained during the previous week. 

2. To provide opportunity for children who already know these 
words to master more difficult ones. 

III. Returns from Informal Tests : 

The tables below show the number of errors made in the first and 
second informal tests given in the 6 city and the 6 rural experimental 
classes — for a total of 225 children : 

Grade 3 Grades 4 and 5 

I * — 1 I 1 


Words 

Errors 
ist test 

Errors 
2 nd test 

Words 

Errors 

1 st test 

Errors 
2 nd test 

I. tea 

IS 

0 

I. led 

97 

2 

2. red 

5 

0 

2. red 

17 

I 

3. heat 

24 

3 

3. heat 

12 

2 

4. sea 

9 

3 

4. sea 

9 

2 

5. and 

12 

I 

5. and 

6 

2 

6. bead 

17 

3 

6. fled 

61 

2 

7. play 

21 

I 

7. bled 

99 

4 

8. clean 

18 

4 

8. able 

35 

3 

9. above 

33 

IS 

9. baby 

20 

4 

10. baby 

IS 

II 

10. their 

83 

7 

II. about 

29 

14 

II. hear 

33 

6 

12. flea 

66 

9 

12. know 

40 

S 

13. dear 

IS 

I 

13- Ned 

69 

5 

14. cage 

24 

7 

14. shed 

49 

17 

15. damp 

39 

7 

15. wear 

68 

II 

16. each 

29 

7 

16. bed 

12 

2 

17. dally 

S8 

7 

17. air 

IS 

3 

18. beat 

27 

S 

18. above 

29 

6 

19. child 

27 

6 

19. about 

27 

S 

20. appear 

7S 

10 

20. add 

6 

4 

Total 

5^ 

1 14 


787 

93 
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What the Results Show : 

1. They show a fine gain as the result of three 15' periods of 
spelling, a gain of approximately 80% in the 3rd grade and of 88% 
in the 4th and 5th grades. 

2. That there are certain words of peculiar difficulty : Grade 3 — 
above, about, baby, appear ; Grade 4 — shed, wear, their, hear, above. 
Can you find out why these words are so difficult? 

If you can, include your observations under Comments in your diary. 

IV. Needs shown in the Morrison McCall Spelling Test. 

During your first week of remedial instruction in spelling you saw 
that the first word in the Morrison McCall Test that presented 
difficulty in Grades 4 and 5 was the word led; in Grade 3 — ^the word 
sea. These are words of the homonym type, and drill lessons were 
planned to suit the type of difficulty involved. The next most fre- 
quently misspelled word in Grade 3 was mine and in Grades 4 and S, 
omit. Lesson types will be given suitable for teaching these words. 

V. Lesson Types : 

Word; Mine. 

Difficulty : Confusion with mind due to faulty listening and to 
faulty pronunciation. 

Teaching emphasis: Upon listening and pronunciation. 

Steps : 

1. Meaning. Teacher writes word on board, pronounces it, and calls 
for sentences. 

2. Pronunciation. Teacher pronounces word distinctly and calls 
attention to the closing sound. Children pronounce individually. 
Teacher calls for other words that end like mine. Teacher writes 
words on board as children give them. After a number of words 
have been given, children practice clear pronunciation of them. 

3. Children write each word, pronouncing it as they write. 

Word: Omit. 

Difficulty: Confusion of first letter with a due to faulty listening 
and pronunciation; lack of familiarity with meaning of word. 

Teaching emphasis: Upon meaning and use; upon listening and 
pronunciation. 

Steps; Same as with word mine, emphasis in pronunciation being 
placed upon the o. 

VI. Organization of the work: 3-15' periods. 

1st period. 

1. Teacher has made a summary of the results of the two informal 
tests for her class similar to the summary the experimenter has made 
for all the children. For this purpose your score sheets have been 
returned to you. Keep these sheets as part of your permanent data. 
Teacher has written the summary on the board. She calls the chil- 
dren’s attention: 

a. To the percentage of improvement. fTo find this, subtract the 
number of errors made in the second test from the number of errors 
made in the first test; divide the remainder by the number of errors 
made in the first test.) Set the goal of a percentage of improvement 
5 points ahead of that made the last time. 

b. To the words most frequently misspelled. (These may or may 
not correspond to the words most frequently misspelled as shown in 
the summary in this bulletin.) Emphasize the need for mastery of 
those words. 

2. Drill the words most frequently misspelled. 
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3. Give the informal test for the week. Test 2a in Grade 3 and 
Test 2b in Grades 4 and 5. 

2nd Period; 

The teacher has scored the informal tests and made entries on one 
of the score sheets provided. Group the children according to the 
results, putting those who made not more than 2 errors in Group i and 
all the rest in Group 2. 

Directed Undirected 

1st s'. Groups I and 2. Teach 

the words to all the 
children which are 
needed by Group 1. 

Remaining time. Teach Group 2 as many Grouj) i — one of the 
of the other words mis- undirected exercises 
spelled as possible. given in Bulletins2. 

3rd Period ; 

Directed Undirected 

1st 10'. Group 2. Continue teach- Group i. Correct ex- 

ing words needed. ercises written dur- 

ing last lesson. (A 
student teacher helps 
children individu- 
ally.) Give another 
undirected exercise, 
Bulletin 2. 

Informal Test — Spelling 2A for Grade 3 


1. above Fayette St. is above Baltimore St. above 

2. mine The book is mine. mine 

3. appear The sun will soon appear. appear 

4. line Draw a straight line. line 

5. about Let us walk about the garden. about 

6. pine The pine tree has long needles. nine 

7. baby The baby is playing. baby 

8. fine The weather is fine. fine 

g. across Walk across the room. across 

10. back Please come back. back 

11. call Please call me early. call 

12. dance We are going to a dance. dance 

13. each Each child has a book. each 

14. fall Try not to fall. fall 

15. game We are playing a good game. game 

16. hand His hand was cold. hand 

17. ice There is ice on the ground. ice 

18. jump How high can you jump? jump 

19. keep Keep your pencils in a box. keep 

20. lake The lake is deep. lake 

Informal Test — Spelling 2B Grades 4 and 5 

1. shed The_ wagon is in the shed. shed 

2. omit Omit the last paragraph. omit 

3. wear She will wear her new dress. wear 

4. obey Obey the rules of the game. obey 

5. open Please open the door. open 
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6. their 

These are their books. 

their 

7. hear 

I hear the birds singing. 

hear 

8. above 

Fayette St. is above Baltimore St. 

above 

9. mine 

The book is mine. 

mine 

10. across 

Walk across the room. 

across 

II. back 

Please come back. 

back 

12. call 

Please call me early. 

call 

13. dance 

We are going to a dance. 

dance 

14. each 

Each child has a book. 

each 

IS. fall 

Try not to fall. 

fall 

16. game 

We are playing a good game. 

game 

17. hand 

His hand was cold. 

hand 

18. ice 

There is ice on the ground. 

ice 

19. jump 

How high can yon jump? 

jump 

• 20. keep 

Keep your pencils in a book. 

keep 

Note. — The above list consists : 



1. Of words most frequently misspelled the second time the first 
informal test was given. 

2. Words like omit or mine frequently misspelled in the Morrison 
McCall Test. 

3. Words selected from the list compiled by Homer J. Smith from 
the examination of 75,000 running words of the spontaneous compo- 
sitions of children. 


3. EXPERIMENT DURING THE THIRD TERM 

While the plan during the third term followed, in general, 
that of the second term, it was possible to organize the work 
with greater definiteness than during the second term and to 
have all subjects taught from the beginning instead of having 
but one of the four experimental subjects taught during each 
of the first four weeks as in the second term. The work was 
planned as follows : 

The 51 school days of the term were divided into 3 units 
of 17 days each. Each of the 3 students assigned to an 
experimental class carried one of the experimental subjects 
during a unit of 17 days and shifted to another subject at the 
end of that unit, arithmetic calculation and problem' solution 
being considered as one subject. 


1st unit (17 days) — Student 
« 

<« 

2nd unit (17 days) — " 

•< 

<* 

3rd unit (17 days) — “ 


A taught arithmetic 


B 

It 

reading 

C 

l( 

spelling 

A 

II 

reading 

B 

fl 

spelling 

C 

Cl 

arithmetic 

A 

<1 

spelling 

B 

II 

arithmetic 

C 

11 

reading 
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In all other respects, the experiment was conducted as 
before. Bulletins were sent out weekly and diary blanks and 
results were sent to the experimenter. Summaries of the 
bulletins are offered here. 

Bulletin lo gave specific directions for ; 

1. Giving the Gray Oral Reading Test 

2. Correcting certain type difficulties in spelling 

3. Practicing S, 7, and 9 addends single column addition 

4. Use of certain type problems in problem solution 

Bulletin ii reported the results of the tests given at the 
close of Term 2. In the case of reading and spelling, com- 
parison was made with the results of the fall tests. In addi- 
tion, detailed score sheets showing the results for each child 
were sent to each center. 

Bulletin 12 summarized the analysis of the March reading 
tests by classes and individuals, detailed analysis for each 
class being sent with the bulletin. Special attention was called 
to the children who had failed to make satisfactory progress 
in reading, individual diagnoses being sent to the centers. 
Effort was made to meet the individual needs more effectively 
by adopting at this point the individual reading system de- 
scribed in Bulletin 12. 

In addition to the analysis of the reading situation, work 
in spelling and arithmetic calculation was directed to be car- 
ried on in the usual way, while arithmetic problem work was 
omitted. 

Bulletin 13 called attention to supplementary reading mate- 
rial available for use in the experimental classes. The bulletin 
also diagnosed the March spelling results in the same way 
that Bulletin 12 diagnosed the reading results, detailed score 
sheets being sent to the various centers. Spelling and arith- 
metic calculation were carried on in the usual way, while 
problem work was again omitted. 

Bulletin 14 gave the details of the plan for reading adopted 
as a result of the findings of the March tests. Work in spell- 
ing, arithmetic calculation, and arithmetic problem solution 
was also provided. 

Bulletin 15 referred to Bulletin 14 for reading aids. It 
suggested different spelling exercises for the sake of variety 
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and also gave additional work in arithmetic calculation and 
arithmetic problem solution. 

Bulletin i6 gave directions for a mid-term testing program 
to be given as a check on the work carried on thus far. 

Bulletin 17 carried forward the work in the four subjects 
in ways outlined previously. 

Bulletin 18 reported the results of the April tests in spell- 
ing and reading and analyzed the results. In addition, indi- 
vidual score sheets were sent to the centers as they had been 
sent in March. 

Bulletin 19 gave the results of the April tests in arithmetic. 
No new work was outlined, the students being advised to 
continue along lines previously indicated. 

All bulletins and all forms, record sheets, and score sheets 
referred to are on file in the library of The Johns Hopkins 
University. Bulletin 14 is given here in full as a sample of 
the bulletins used during this term. 

Bulletin 14 

Week of April 13, igas. 

TEST-DETERMINED INSTRUCTION FOR EXPERIMENTAL CENTERS 

Reading 

Foreword to the Instructors : 

Our recent testing has shown a fine average gain made by most of 
our classes. On the other hand, it has shown two conditions which are 
not gratifying : 

1. The percentage of children making no progress is unduly large. 

2. The children who are making least progress are those who, in 
general, made the highest scores in the fall testing. 

Our problem has, therefore, become; How can we administer our 
test-determined instruction so that every child may be insured some 
growth by reason of that instruction? 

If we solve this problem or, even, if we make some advance toward 
its solution, our next test results should show practically all of the 
children — good readers and poor readers — pushing ahead of their 
previous record. The average class gain may be no greater. It may 
not be as great. That is of little significance. The true criterion of 
the efficiency of instruction is individual progress proportionate to 
ability. Can we find a solution? 

Let us look at the difficulties ; 

1. To insure such progress, the instruction must be differentiated. 

2. Differentiated instruction involves the division of the class into 
small groups, or, individual instruction, or, a combination of both. 

3. Such instruction is difficult to administer in large classes under 
ordinary circumstances. 
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4. The administrative difficulties are increased many times when 
the work is done by student teachers who— no matter how great their 
teaching ability is — lack that skill in class management which only 
experience gives. 

In the light of the above difficulties, our major problem includes two 
specific problems in “ways and means.” We must find a way: 

1. To reduce the time required for preparation on part of the 
teacher to a minimum. 

2. To work out a scheme of class management that may be reduced 
to a more easy routine. 

The plan submitted in this bulletin is an attempt at a solution of the 
major problem. At the same time, every possible consideration has 
been given to the two specific problems. Its success depends, primarily, 
upon two things : 

1. The enthusiasm that the teacher can rouse in her children. 

2. The extent to which the teacher can routinize the filing of mate- 
rials, their distribution and collection, and the keeping of records. 

The Plan 

The plan provides ; 

1. Intensive reading of a small unit of material carefully selected 
with reference to levels of difficulty, such reading to be done under 
time pressure. 

2. Extensive reading of larger units of material carefully selected 
with reference to levels of difficulty, such reading to be done without 
time pressure. 

3. Drill in mechanics as need for such drill is shown in the two 
exercises outlined above. 

How to carry out the plan ; 

1. The intensive reading 

Materials needed : 

Mimeographed exercises; mimeographed question blanks; class 
record sheet; pupils’ record sheets; reading diary blanks. 

Flan: 

See directions on materials accompanying bulletin.* 

2. The Extensive Reading 

Materials needed : 

Books of varying levels of difficulty to suit the needs of the various 
groups. It is not necessary to have enough of any one kind for a 
group. Suitability to the needs of the group is the important point. 

Class Record. (Same as for intensive reading.) Pupil record for 
extensive reading. (After Winnetlra Plan.) 

What to do at first lesson ; 

a. Explain the plan to the children as follows : That books will be 
provided for them to be enjoyed as much as possible; that when they 
have finished reading a book, they are to fill out the book record (show 
it and explain how to use it) ; that if the record satisfies the teacher, 
another berak will be given to them. 

b. Distribute the books — ^if you have not already done so — and let 
the children read silently. 

What to do at succe^ing lessons : 

a. During the first and second periods of each week, the children 
are to be permitted to go on with their extensive reading after they 
have corrected their intensive exercises. 


Appendix K. 
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b. The third period of each week is to be devoted entirely to this 
phase of the work. 

During the first fifteen minutes, pass among the children giving 
such help as they seem to need. As in the intensive reading, you 
will learn gradually how to make this help effective. Let your help 
always be of such character that it will make the children better able 
to cope with other difficulties. Rely as much as possible on word 
analysis in meeting difficulties with words. (See Bulletin 4.) 

How much time is to be used : 

One full period a week. 

Such time as the children have left over from the correction of the 
exercises during the other two test-determined instruction periods. 

Any other free time that the children care to use. 

How the work is to be recorded : 

a. By the teacher in the column marked for the purpose on the 
Gass Reading Record, such record to be made when a reading unit has 
been completed. 

b. By the pupil when he completes a reading unit. 

c. By the teacher on the reading diary blank. 

3. Drill 

Drill during the test-determined instruction periods is to be confined 
to such needs as are noted during the other exercises. The experi- 
menter will be able to give definite help in this phase of the work after 
you send in returns. 


Returns to the Experimenter 

i.i Reading diary blanks. 

a. The corrected question blanks. 

Additional Notes on Reading 

Instructions to Children at Beginning of an Intensive Exercise. 

“ The exercise which I am about to give you will do much to improve 
your reading. We will all read for exactly the same length of time. 
Begin to read when I say ‘Read. Stop when I say Stop.’ Read as 
fast as you can, but be sure to get the meaning. The aim is to get 
all the meaning you can the very first time you read something. After 
you finish reading, I will give you some questions about what you 
have read. Let us see how many of the questions you can answer 
correctly.” 

Directions for Scoring Intensive Exercises. 

The key provided with the exercises gives the answers to the 
questions expressed in the fewest possible words which may be 
accepted as correct. The children’s answers must include at least all 
of these words. If additional words are given, consider the answer 
correct if such words clarify or enrich the meaning. Consider such 
answers incorrect if the additional words distort the meaning. 

Mark each answer l. The total score is the number of correct 
wswers. Do not mark the incorrect answers. Use a colored pencil 
in marking. 

Note. — Carefully file the exercises after the children have used 
them. What you use for one group one week may be material for 
other children later. The experimenter will try to gauge from the 
records and from your reports which exercises you need and will 
send additional exercises in case of emergency needs. Be as explicit and 
prompt in your returns as possible, for it is through your returns that 
the experimenter knows best what to send you. 

6 
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Spelling 

The gratifying results of the second testing in spelling warrant our 
continuing the same procedure. You are asked to pay particular atten- 
tion to the following points : 

1. Keep the ideal of increase in accuracy before the children con- 
stantly. Show them the increase in the average class score in the 
second test over the first. If a child fails to improve in the second test 
over the first, try to discover the couse of such failure. 

2. Provide worth-while exercise for the group who show, in the 
first test, that they do not need drill. For suggestions, see Bulletins 
2, 5, and 12. 

Instead of the diary forms formerly used, please send the experi- 
menter the following data each week : 

1. List of the class with the scores made in each of the two tests. 

2. The three most frequently misspelled words with the number of 
errors made in each test. 

3. A list of the words that you taught. 

4. The type of exercise given the group that did not need the drill. 

5. Any comments that you care to make. 

Work of the Week : 

The work is based upon the word, friend, a source of difficulty 
in the first standard test. The silent i is the cause of difficulty. 

Word— /fiend. 

Difficulty — silent i. 

Teaching emphasis — ^visual stimulus and motor response. 

Steps : 

J. Teacher writes word on board and pronounces it. 

2 . Children give a few sentences to show that they understand the 
use of the word. 

3. Teadier asks children: "How many sounds are in the word?” 
(5). How many letters ? (6). Which is not sounded? 

4. Children write word several times, spelling aloud as they write. 


Informal Test 


I. friend 

She is my friend. 

friend 

2. girl 

She is a pretty girl 

girl 

3- glass 

Please wash the glass. 

glass 

4- gone 

They have gone home. 

gone 

5. had 

She had an interesting book. 

had 

6. into 

He fell into the water. 

into 

7. thread 

The thread is strong. 

thread 

8. read 

I have read the book. 

read 

g. half 

He bought a half pound of candy. 

half 

10. high 

The fence is high. 

high 

II. just 

She has just finished. 

just 

12. kill 

Did he kill the fly? 

kill 

13. June 

School closed in June. 

June 

14. lake 

He rowed on the lake. 

lake 

15. land 

Land was in sight. 

land 

16. law 

He is studying law. 

law 

17. lot 

He bought a house and lot. 

lot 

18. lay 

Lay the book down. 

lay 

19. led 

He led the horse home. 

led 

20. mine 

The book is mine. 

mine 
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Arithmetic Problems 

You are asked to organize the work in arithmetic problems similarly 
to that in spelling. That is : 

1. Give 3-is' periods per week. 

2. At the first period, give an informal test to all the children. 

3. During the second period, devote the first ten minutes to the 
children who did not have perfect scores in the test. While you are 
teaching these children, give more advanced work to the rest. During 
the last 5 minutes check the work of the latter group. While you are 
doing this, have the other group correct their papers. 

4. During the third period, give another informal test similar to the 
first one only to those children who failed to have perfect scores in 
the first. Continue the more advanced undirected work with the other 
children. 

Mark these papers carefully, giving them back from lesson to lesson 
for correction. 

Please remember, that this work emphasizes the reading of the 
problem and the thinking of the solution. The calculation is purposely 
kept as simple as possible. 

Do not use the old diary form in reporting this work to the experi- 
menter. Instead, send her the following information : _ 

1. A class list showing the scores made by the various children in 
each test. 

2 . An example of the type of work that you are giving to the 
children who do not need this work. 


First Informal Test 

1. How many are 8 pencils and 4 pencils? 

2. If you do 5 examples in arithmetic every day for S days, how 
many have you done in all? 

3. If you have 10 pennies and lose 3 of them, how many would you 
have after you found one of them? 

4. How many pies are needed to serve 24 people, if you can cut 
6 slices out of a pie? 

5. John worked 3 days at $2 a day. Out of his earnings he bought 
a hat for $2, a book for $1.50, and some candy for $.25. How much 
has he left? 

6. How much change would you get from a dollar bill after buying 
X doz. eggs for $.35, i Ib. butter for $.50, and i loaf of bread for $.10? 

7. If the price of lemons is 2 for 5 cts., how many can you buy for 
$.50? 


Second Informal Test 

1. How many are g cents and 3 cents? 

2. If you walk 3 miles a day for 7 days, how many miles have you 
walked in all? 

3. If you have 12 marbles and lose 3 of them and then get 2 others, 
how many have you? 

4. How long will it take you to do 20 problems in arithmetic, if it 
takes you 5 minutes to do one? 

5. John worked 4 days at $i a day. Out of his earnings he bought 
a book for $1, a bdl for $.75, and some pencils for $.25. How much 
had he left? 
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6. How much change will you get from a dollar bill after buying a 
ball for 50 cents, some marbles for 15 cents, and a ball of cord for 
S cents? 

7. If the price of pencils is 2 for s cents, how many can you buy 
for a quarter? 


Arithmetic Calculation 

Experience has shown that children are inclined to add or to subtract 
the denominators of common fractions when called on to add or to 
subtract such fractions. Furthermore, they are apt not to reduce the 
answers to lowest terms. The drill this week aims to correct these 
errors and to render automatic the responses to addition and sub- 
traction of simple fractions of the same denominator. 

Use any drill device that you wish in doing this work. 

If you teach third grade and the children have had no experience 
with fractions, omit the test-determined calculations entirely this week. 

In sending in returns, do not use the old diary form. Instead, send 
the experimenter the following : 

A list of the children’s names with scores in the informal test to be 
given at the third period. Also, add any remarks that you wish. 

Informal Test 

i plus i 1 plus 3 i plus i J plus i S plus J 
i plus I i plus i i plus J J plus i I plus i 

izt fzj j=| fz{ {z| 



CHAPTER VII 

The Experiment as it Was Carried Out 

To have carried out the work outlined in the bulletins as 
given in Chapter VI in all the details indicated would have 
meant the expenditure of time given in Table XII. From 


TABLE XII 

Expenditure of Time to be Devoted to Experimental Teaching 
According to Bulletin Directions 

Spelling Arith. Cal. .•\rith. Prob. Total 


Bui. 


Reading 


6o 


4 

3 

30 

90 

5 

6 

3 

30 

90 

7 

3 

30 

90 

fi 

3 

30 

90 

9 

Testing 


— 

— 

— 

Tot. ' 

[■* 

30 

4 S 0 

Term 

i ^ 

10 

3 

30 

90 

sx 

3 

30 

90 

la 

3 

30 

90 

13 

3 

30 

go 

14 

3 

30 

90 

>5 

3 

30 

90 

x6 

Testing 

17 

3 

30 

90 

18 

3 

30 

go 

39 

3 

30 

90 

— 


•«- 


Tot. 

a? 

30 

8x0 

TerntJ 





_ 



Tot. 

4 X 

30 


Both 

Terms 


'Pd. L. T.’ 

Pd 

. L 

u T\ 

Pd. 

L. 

T. 

3 

15 

45 

3 

IS 

45 




3 

15 

45 







3 

IS 

45 




3 

30 

90 

3 

IS 

45 

3 

IS 

45 

3 

IS 

45 

3 

IS 

45 

3 

15 

45 

3 

IS 

45 

- 


— 

— 

— 

— 




15 

IS 

225 

9 

15 

135 


301 

isC 

180 

3 

IS 

45 

3 

15 

45 

3 

15 

45 

3 

15 

45 

3 

15 

45 

3 

15 

45 

3 

IS 

45 

3 

15 

45 




3 

IS 

45 

3 

IS 

45 




3 

15 

45 

3 

15 

45 

3 

15 

45 

3 

IS 

45 

3 

IS 

4 S 

3 

15 

45 

3 

15 

45 

3 

IS 

45 

3 

15 

45 

3 

15 

45 

3 

IS 

45 

3 

IS 

45 

3 

IS 

45 

3 

1$ 

45 

3 

IS 

45 

37 

15 

405 

37 

15 

405 

21 

IS 

315 

41 

15 

630 

36 

IS 

540 

30’ 

15 

495 


Pd. L. 


1 105 


* Len^h of periods CMressed in minutes. 
Pd. — Number of periods. 

L. — Length. 

T.-TotaI. 


30 

15 

XS 

30 

IS 

30 

*5 

30 

15 

15 

30 


30 

IS 


T. 

60 

45 

45 

90 

45 

90 

135 

135 

90 


5 » 

450 * 


[ 6 

3 

I i 

1 3 
! * 

< j 

\fs 


960 

30 

90 

IS 

X 35 

30 

90 

IS 

135 

30 

90 

IS 

90 

30 

90 

15 

90 

30 

90 

15 

X 35 

30 

90 

IS 

135 

30 

90 

15 

135 

30 

90 

15 

135 

30 

90 

15 

I 3 S 

30 

810 

15 

1X2$ 

1935 

30 

xjao 

15 

XS 7 S 

2805 or 

48 hr. 

IS' 
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the viewpoint of the amount of time planned for the experi- 
ment, the above table indicates that : i. More time was gfiven 
in the third term than in the second ; 2. The work was more 
regularly arranged in the third term than in the second; 
3. In both terms more time was given to reading than to any 
one of the other three subjects. 

The amount of time actually devoted to the work in each 
of the experimental centers was calculated. The source of 
the information is the diary blanks on which the students 
were asked to indicate the amount of time actually used. 
While this information is subject to the usual error found 
wherever such method is used, all precautions were taken to 
procure accurate records in this respect.' 

Tables XIII, XIV, and XV summarize the expenditure 


TABLE xni 


Total Expenditure of Time Reported of Experimental Teaching 
ON Each Subject in Each Experimental Center 


Readlnfi 
Allotted time 
1230' 


SpellinK 
Allotted time 
630' 


Arith. Cal. 
Allotted time 
540' 


Aritb. Prob. 
Allotted time 

495' 


H 

1290 

A 

640 

A 

1210 

B 

545 

M 

1190 

F 

497 

G 

1115 

H 

495 

L 

1058 

D 

480 

E 

1050 

JK 

450 

F 

104a 

C 

435 

I 

975 

E 

430 

JK 

945 

G 

405 

C 

916 

I 

385 

D 

870 

M 

360 

B 

660 

L 

265 


H 

58s 

L 

460 

I 

46s 

F 

420 

D 

465 

I 

405 

L 

435 

A 

405 

A 

430 

M 

395 

E 

400 

D 

365 

F 

394 

G 

345 

G 

330 

H 

345 

M 

265 

C 

310 

C 

250 

B 

270 

B 

230 

E 

255 

JK 

230 

JK 

180 


TABLE XIV 


Average Expenditure of Time Reported on Experimental 
Teaching of Each Subject in Each Type School 
Situation 


Reading 
Spelling _ 
Arithmetic Calc. 
Arithmetic Prob. 


CitT Campus 

958.00' 1126.66' 

504-50' 42&30' 

361.50' 460.00' 

337.50' 365.00' 


Rural 

1064.30' 

358.20' 

309.30' 

345.00' 


* Tables indicating the amount of time reported actually given each 
week in each school to each subject are filed in the library of The 
Johns Hopkins University. 
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TABLE XV 


Average Expenditure of Time Reported on Experimental 
Teaching of Each Subject in Each Grade and in 
Entire Experimental Group 



Grade 3 

Grade 4 

Grade 5 

Total 

Reading 

982.50' 

1047.2s' 

1043 - 33 ' 

1026.75' 

Spelling 

517.50' 

414.16' 

397.83' 

36430' 

448.91' 

Arithmetic Calc. 

305.00' 

371.33' 

342.50' 

373.08' 

Arithmetic Prob. 

300.00' 

352.60' 

346.25' 


of time used in test-determined instruction in the four sub- 
jects by individual classes, type school situation, and by grade 
respectively. 

Table XIII shows no tendency toward constancy of rank 
in time expenditures by any particular class or classes. Thus, 
Class H which ranks first in time allotted to reading, ranks 
fourth in spelling, first in arithmetic calculation, and eighth 
in arithmetic problem solution. Class B which ranks twelfth 
in time allotted to reading ranks second in spelling, eleventh 
in arithmetic calculation, and tenth in arithmetic problem 
solution. 

Table XIV shows that the campus elementary school in 
general gave more time to the experimental work than the 
city and rural schools gave. Averaging the ranks of each, the 
relative positions in time expenditure of the three type school 
situations are: i. Campus, 1.25; 2. City, 2.25; 3. Rural, 
2.50. 

Table XV shows a tendency in Grade 4 to outrank the 
other two grades in amount of time expended. Averaging 
the ranks for each grade, the relative positions in time expen- 
diture are: l. Grade 4, 1.50; 2. Grade 5, 2.00; 3. Grade 3, 
2.50. 

No doubt the character of the work done by the students 
varied to as great, if not a greater, extent than the time used. 
Of this, there is no measure. The character of the diary 
reports varied from those which gave the experimenter but 
little information to those done with the utmost care. Three 
samples of such diary reports are offered as t)rpes of poor, 
average and superior reports. 
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Sample of a Poor Diary 
DIARY : test-determined instructions 

1. School z Grade 4 & S 3- Date Jan. 27 4. Time 10.45-11.00 

5. Num. of Minutes 7i Activity i : From 10.45 to 10.52 

“ 2 ; From to 

6. Subject Spelling “ 3: From to 

8. Types of Instruction 7. Groups or class 

Activity i Directed 
“ 2 Undirected 

“ 3 

9. Materials Used: 

Bulletin 2 

10. Comments: . 

Work went very well 

11. Disciplinary Cases: 

12. Absent: 

(Name) 

(Name) 

Approved : Signed 

Student Teacher 


Sample of a Fair Diary 

DIARY : TEST-DETERMINED INSTRUCTIONS 

I. School 2. Grade Fifth 3. Date Jan. 19 

4. Time Activity r : From 10.45 to 10.50 

“ 2: From 10.50 to ii.oo 

“ 3: From to 

5. Num. Minutes Fifteen 7. Groups or class: 

6 . Subject Spelling Class as a whole 

8. Types of Instruction : 

Activity i : Presenting chart 
“ 2: Giving informal test 

9. Materials Used: Used words given in Bulletin 2. Marked, in- 

formal test Grades 4 and 5 

10. Comments : There were a few youngsters who remarked, while 

I was dictating the words, that these words were baby words. 
The pupils who said this were 3, 6, 8 

11. Disciplinary (Tases: There was nothing unusual in this lesson 

regarding discipline. The test was given without any inter- 
ference from the pupils 

12. Absent: 

None were absent 

Approved : Signed 


Student Teacher 
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Sample op a Good Diary 
diary: test-determined instruction 

School Grade Date 

M. S. E. 4 April i, 1925 

Number of minutes — 30 

Subject — ^Reading 

Group — Experimental 

Types of instruction 

Activity l Time 1.45-2.15 
“ 2 

3 

Materials used : 

Series of exercises sent out by the experimenter 
Comments 

The exercises are given out according to the instruction given 
in Bulletin 12. We have no 4th group to work with. At first the 
material seemed difficult for all the groups but after they had 
mastered the first and second problems all seemed very much 
interested in the work. 

Results 

Group III handed in very good papers had a perfect 

paper. The results from the others in this group showed ffiat 
they were capable of doing more difficult work if they would just 
try to do so. 

Group II handed in very good papers. Very few errors were 
made and these were due to carelessness in reading the paragraph 
rather than to lack of comprehension of what was read. 

Group I seemed to have more difficulty with the exercise given 
them than the other groups did. Question I seemed quite mis- 
leading to them. Other errors were due to not thinking through 
or puzzling out the answer to the question asked. 

Disciplinary Cases: 

Absent: Signed 

There were many evidences in the diary reports of careful 
observation of the children and of study of their problems. 
A few random samples are quoted : 

“ Most of the children did not know the meaning of the word fled.” 
“ Three of the children said that the words in the test were baby 
words.” "I dictated the words a little too fast in the second test 
which, I think, accounts for some of the low scores.” “ Some of the 
children counted by making dots.” " The children wanted to multiply 
in every problem at first.” (The problems included miscellaneous 
processes.) “In writing the word baby many of the b’s were madb 
like I’s; in now, the w was made like u.” “The children count on 
their fingers ; more drill in tables is needed.” “ The children do not 
know how to use o in subtraction.” “I made a mistake in teaching 
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the word speech. I spelled it speach." “ Children realized their diffi- 
culty in ‘ taking away ’ in subtraction and asked for help.” “ The first 
information tests in spelling were accidentally destroyed and the work 
in spelling was discontinued for the week.” “ The time allowed for 
the reading exercises seems too short to make them of value.” 

In addition to such comments, many of the diaries included 
detailed analyses of the work of individual children. On the 
whole, there was a conscientious effort to carry out the work 
in accordance with the directions in the bulletin, though the 
work was subject to many interruptions. 



CHAPTER VIII 
The Results 

I. THE MAIN criterion: THE PROGRESS OF THE PUPILS 

The results were computed on the basis of the final equa- 
ting as given in Chapter IV : 

1. By the scores on the separate tests. 

2. By the composite scores of the tests in reading, in spelling, in 
arithmetic calculation, and in arithmetic problem solution. 

The method of computation and the results of each of these 
two phases will be treated separately. 

Tee Results as Measured by Difference Between Inttial and 
Final Status in Each Test 

Each pupil’s score in each initial test was subtracted from 
his score in the corresponding final test. These differences 
were averaged for control and experimental groups : 

1. By individual classes. 

2. By the combination of classes into three experimental and three 
control groups according to grade— Grades 3, 4, and S- 

3. By the combination of classes into three experimental and three 
control groups according to type school — city, campus, and rural. 

4. By the combination of all classes and schools into one experi- 
mental and one control group. 

Tabulation of the detailed results is filed in the library of 
The Johns Hopkins University. A summary of results ac- 
cording to individual classes is shown in Tables XVIa and 
XVIb and a summary according to grade, type of school, and 
total experimental and control groups is given in Table XVII. 

Comparative gains of the experimental and control groups 
are given in terms of mean only. (Variabilities and relia- 
bilities are computed for the composites.) 

Attempt is made in Figures ii, 12, 13, 14, 15, 16, 17, and 
18 to show the relative average gains of the experimental and 
control groups by comparison with a normal year’s growth 
in the various tests. The normal growth between the begin- 
ning and the end of the 3rd grade according to the Stanford 

81 
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Figure ii. — Comparison of gains made by experimental and control classes 
ing. S ; A normal year’s growth ; £ : Experimental ; C : Control. The graphs 
arranged in the same order. 
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Figure 12. — Comparison of gains made by experimental (E) and control (C) 
according to type school situations: City, rural, cai 
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TABLE XVII 


SuMHABy OF Average Gains by Grades, Type Schools and Totals ‘ 



Total 

Total 

Total Total 

Total 

Total 

Total 


City 

Campus 

Rural Gr. 3 

Gr. 4 

Gr. 5 

All 



Experimental 







Reading 




T. McC. 

7.33 

5-11 

4.89 7-25 

5.81 

6.93 

6.61 

S. 

II.71 

985 

9.63 12.78 

10.58 

10.26 

II.19 

M. C. 

I.17 

.31 

.80 1.10 

•71 

1.22 

1.03 




Spelling 




M. McC. 

4-31 

3.80 

2.78 6.02 

3.51 

2.8s 

403 

S. 

12.17 

21.17 

12.16 18.84 

12.83 

10.23 

13.43 



Arithmetic Calculation 




M. 

14.50 

7.96 

1449 12.72 

15.75 

11.28 

13.25 

S. 

30.29 

19.26 

17.36 28.90 

14.10 

18.73 

19.67 

C. 

23.02 

18.76 

18.21 31.53 

29.0s 

4.96 

21.42 



Arithmetic Problems 




B. • 

S.27 

6.80 

4.16 6.33 

4.14 

5-73 

Fi 

S. 

7-30 

11.72 

9.02 9.20 

7.81 

7B0 

8.18 




Control 







Reading 




T. McC. 

6.48 

3.45 

4.16 7.20 

4.16 

6.09 

5.70 

S. 

10.59 

12.07 

3.86 13.06 

8.69 

8.51 

10.07 

M. C. 

■15 

•94 

.03 .75 

-.41 

•43 

.21 




Spelling 




M. McC. 

4.87 

3-54 

24s 5.13 

448 

3.62 

4-37 

S. 

12.68 

16.55 

12.27 16.07 

9.86 

14-94 

13.19 



Arithmetic Calculation 




M. 

12.22 

8.56 

11.63 11.76 

13.17 

10.02 

11.63 

S. 

19.09 

15.20 

18.33 28.51 

13.87 

15.37 

18.33 

C. 

14.56 

18.97 

23.84 28.00 

23.24 

3.27 

17.55 



Arithmetic Problems 




B. 

5-71 

330 

7-31 6.73 

4.56 

6.08 

5.66 

S. 

7.66 

8.96 

9.46 10.03 

7.21 

7.6s 

8.12 
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TABLE yiVll,— Continued 



Type School 

Grades 


Total 



Greater 

Greater Greater Greater 

Greater 

Greater 


£ 

C 

£ 

c 

£ 

C 




Reading 




T. McC. 

3 

0 

3 

0 

I 


S. 

2 

I 

2 

I 

1 


M. C. 

2 

I 

3 

0 

I 


Total 

7 

2 

8 

I 

3 

0 




Spelling 




M. McC. 

2 

1 

I 

2 


I 

S. 

I 

2 

2 

I 

I 


Total 

3 

3 

3 

3 

I 

I 



Arithmetic CalculatioH 




M. 

2 

I 

3 

0 

X 


S. 

2 

I 

3 

0 

X 


C. 

I 

2 

3 

0 

X 


Total 

5 

4 


0 

3 

0 



Arithmetic Problems 




B. 

I 

2 

0 

3 


I 

S. 

I 

2 

I 

2 

I 


Total 

2 

4 

X 

5 

I 

I 


17 

13 

21 

9 

8 

2 


^ Tbe initials appearing at the left of the table designate the various tests used, 
as follows; 

T. McC. Thorndike McCall Reading 

S. Stanford Achievement— Reading>—Spelling^Arit]imetic 

M. C. Monroe Reading Comprehension 

M. McC. Morrison McCul Spelling 

M. Monroe 

C. Courtis 

B. Buckingham 

Reading Age norms was taken as the base (Figure H, ist 
column). The growth made by the experimental and control 
classes was measured proportionately. Similarly, Grades 4 
and s were blocked off. Growth as measured by the other 
tests was blocked proportionately also to the Stanford norm. 
Thus, in Thorndike McCall Reading, a growth in terms of 
T Score of 3.6 points is normal for the time between the 
beginning and the end of the 3rd grade. Hence, a column of 
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the same height as the column for normal third grade growth 
in the Stanford Test was used to indicate the 3.6 points of 
growth according to Thorndike McCall, while the actual 
growth made by the experimental and control classes was 
measured proportionately. 

The tables and figures indicate : 

1. That when the results are studied by individual classes (Table 
XVIa, b), more experimental than control classes make greater gain 
in reading, arithmetic calculaticm, and spelling, while in arithmetic 
problem solution the balance is slightly in favor of the control group. 

27 experimental and 9 control classes make greater average 
gain in reading. 

^ experimental and 12 control classes make greater average 
gain in arithmetic calculation. 

14 experimental and 10 control classes make greater average 
gain in stalling. 

II experimental and 12 control classes make greater average 
gain in arithmetic problem solution, while in one case the average 
gain of the experimental and the control groups is the same. 

2. That when the classes are combined by grades (Table XVII), 
in every test in each grade in arithmetic calculation and in ev^ case 
but one in reading, the experimental groups make the greater gain; 
while in spelling the classes making the greater gain are evenly 
divided between the experimental and control groups, and m arith- 
metic problem solution the balance is in favor of Ae control group. 

8 experimental and i control exceed — reading. 

9 experimental and 0 control exceed — ^arithmetic calc. 

3 experimental and 3 control exceed — spelling. 

I experimental and 5 control exceed — arithmetic prob. 

3. That when the classes are combined by types of schoob in reading 
and arithmetic calculation (Table XVTI), a greater number of experi- 
mental classes make the greater gain, while in spelling the numbers are 
the same, and in problem solution the balance is in favor of the control 
groups. 

4 That the three type school situations differ in respect to relative 
gains of experimental and control groups in the various subjects as 
follows : 

City: 

3 experimental and 0 control exceed — reading. 

o experimental and 2 control exceed — spelling. 

3 experimental and 0 control exceed — arithmetic calc. 

0 experimental and 2 control exceed — arithmetic prob. 

Campus : 

1 experimental and 2 control exceed — reading. 

2 experimental and 0 contrcd exceed — spelling. 

1 experimental and a control exceed — arithmetic calc. 

2 experimental and o control exceed — arithmetic prob. 

Rural : 

3 experimental and 0 control exceed — reading. 

I experimental and i control exceed — spelling. 

I experimental and 2 control exceed — ^arithmetic calc. 

o experimental and 2 control exceed — arithmetic prob. 
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S- That among the city and campus classes, a greater number of 
excess gains is made by the experimental than by the control, while 
in the rural classes the number of excess gains of experimental and 
control classes is the same. 

City : In 6 tests the average is greater for experimental and in 
4 for control. 

Campus : In 6 tests the average is greater for experimental and 
in 4 for control. 

Rural : In s tests, the average is greater for experimental and 
in S for control. 

6. That when all classes are combined regardless of grade or type 
of school into two big groups — experimental and control (Table 
XVII) — in each of the three tests in reading and in each of the three 
tests in arithmetic calculation, the experimental group exceeds the 
control, while in each of the two tests in problem solution and in 
spelling, the experimental group exceeds in one and the control in 
the other. 

Reading: Experimental exceeds in 3 and control in 0 tests. 

Ar. Calc. : Experimental exceeds in 3 and control in o tests. 

Spelling: Experimental exceeds in i and control in l tests. 

Ar. Prob. : Experimental exceeds in i and control in I tests. 

7. That the amount of difference between the gains made by the 
experimental and control groups is appreciable and varies with the 
grade and type school (Figures ii, 12, 13, 14, IS, i6, 17, and 18). 


The Results as Measured bv Difference Between Initial and 
Final Status in Composite Scores 

Composite scores of the results of the final tests were 
derived in the same way as were the composite scores in the 
initial tests (Chapter IV). In each case, the difference be- 
tween the initial and the final composite scores was computed 
and the scores averaged by grade, type of school, and total 
group. The results were computed for the composites de- 
rived from both the weighted and the unweighted scores as 
expressed in mean, standard deviation, and reliability. 

The reliability of the gains; i. e., the reliability as influ- 
enced by the number of cases, was computed according to the 
formula for Standard Error (S. E.) : 


S. E.= 


S. D. dis. 

VN 


The results in terms of mean, S. D., and S. E. are given irf^ 
Tables XVIII, XIX, XX, XXI, XXII, XXIII, XXIV, and 
XXV. 
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TABLE XVIII 

Composite Reading Gains by Grades 


Experimental Control 


Grade 

Cases 

Mean 

S. D. 

S.E.’ 

Cases 

Mean 

S.D. 

S. E. 




UNWEIGHTED 




3 

29 

49.24 

15.40 

9-15 

29 

55.06 

18.10 

3.36 

4 

39 

40.66 

15.40 

2.46 

39 

27.74 

20.70 

3.30 

5 

33 

23-54 

21.50 

3-74 

33 

28.36 

20.40 

3.55 

Total 

lOI 

37.53 

20.30 

2.Q2 

101 

35-79 

22.90 

2.27 




WEIGHTED 





3 

29 

108.00 

39-40 

7-32 

29 

114.89 

42.40 

7.88 

4 

39 

9246 

54-20 

8.68 

39 

68.48 

5560 

8.91 

S 

33 

58.09 

47.60 

8.29 

33 

63.82 

46.80 

8.IS 

Total 

101 

85.69 

55-40 

5.51 

lOI 

80.28 

5480 

545 




TABLE XIX 






Composite Spelling Gains by 

Grades 





Experimental 



Control 


Grade 

Cases 

Mean 

S. D. 

S.E.' 

Cases 

Mean 

S. D. 

S. E. 




UNWEIGHTED 




3 

35 

37-63 

22.30 

3.77 

35 

37.23 

19.70 

3-33 

4 

51 

22.06 

19.30 

2.70 

51 

2241 

16.60 

2.32 

5 

43 

18.42 

17.90 

2.73 

43 

25.63 

19.30 

2.94 

Total 

129 

25.04 

21.60 

1.84 

129 

27.50 

19.40 

1.70 




WEIGHTED 





3 

33 

55-65 

33-70 

5.70 

35 

52.94 

27.10 

4-58 

4 

51 

29-59 

28.90 

4.04 

51 

31.72 

25.60 

3-58 

5 

43 

29.44 

32.80 

4.04 

43 

38.42 

28.90 

4.41 

Total 

129 

36.61 

31-50 

2.79 

129 

39.69 

28.50 

2.50 




TABLE XX 





Composite Arithmetic Caiculation Gains by Grades 




Experimental 



Control 


Grade 

Cases 

Mean 

S. D. 

S.E. ' 

Cases 

Mean 

S.D. 

s.e1 




UNWEIGHTED 




3 

27 

96.29 

30,90 

5-95 

27 

81.26 

32.90 

6.34 

4 

40 

43-50 

33-00 

5.22 

40 

36.67 

43-00 

6.96 

5 

37 

54.92 

25.00 

1.82 

37 

46.32 

27.90 

4.58 

Total 

104 

61.27 

36.70 

3.60 

104 

51.69 

36.70 

3.60 





WEIGHTED 





3 

27 

125.21 

38.90 

7-49 

27 

113.66 

4340 

4.18 

4 

40 

56.72 

42.20 

6.67 

40 

52.25 

23.00 

3-63 

S 

37 

73.97 

41.90 

6.89 

37 

S 9 - 0 S 

3740 

6.1S 


104 80.64 50-00 4.97 104 70.61 49.80 4.9s 


Total 
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TABLE XXI 

Composite Arithmetic Problem Gains by Grades 

Experimental Control 


Grade 

Cases 

Mean 

S.D. 

S.E.’ 

Cases 

Mean 

i 

S. D. 

S. E. 




UNWEIGHTED 




3 

33 

15-78 

16.60 

2.87 

33 

19-SI 

11.00 

1.90 

4 

57 

11.49 

20.50 

2.71 

57 

7-58 

14.90 

1.97 

5 

55 

5 -SO 

16.40 

2.21 

55 

4-50 

17.50 

2.36 

Total 

145 

10.71 

18.70 

1-55 

145 

9.80 

22.20 

1.89 




WEIGHTED 





3 

33 

23-79 

24.20 

4.19 

33 

28.82 

21.80 

3.77 

4 

57 

18.22 

27.00 

3.58 

57 

14-65 

26.90 

3-56 

5 

55 

16.32 

27.60 

3.72 

55 

11-43 

29.20 

3-94 

Total 

145 

15-74 

27.00 

2.24 

14s 

13.87 

27.70 

2.30 




TABLE XXII 





Composite Reading Gains by Type Schools 




Experimental 



Control 


Type 

Cases 

Mean 

S. C. 

S.E. 

Cases 

Mean 

S. D. 

S. E. 




UNWEIGHTED 




City 

85 

38-98 

21.20 

2.29 

81 

37.24 

22.30 

2.48 

Campus 

10 

28.00 

26.40 

8.35 

12 

33.58 

22.40 

6.47 

Rural 

6 

32-83 

9.50 

3.89 

8 

24-37 

23-70 

7.IS 




WEIGHTED 





City 

85 

87.96 

56-95 

6.17 

81 

83.39 

51.00 

5-66 

Campus 

10 

77.30 

52.62 

16.64 

12 

84.7s 

34.33 

-6^61 

9.92 

Rural 

6 

67-50 

33-89 

13-89 

8 

42.12 

23.23 




TABLE XXIII 





Composite 

Spelling 

Gains 

BY Type Schools 




Experimental 



Control 

i 



Type 

Cases 

Mean 

S. D. 

S.E.’ 

Cases 

Mean 

S. D. 

S. £. 




UNWEIGHTED 




City 

98 

24-is 

19.40 

1-95 

93 

27.50 

17-90 

1.80 

Campus 

19 

36.47 

20.50 

4.71 

19 

35.88 

23.90 

5-49 

Rural 

12 

17.58 

27.80 

8.03 

17 

15.72 

18.50 

5-34 





WEIGHTED 





City 

98 

33.88 

28.25 

2.85 

93 

40.60 

26.85 

2.71 

Campus 

19 

55-10 

31-30 

7-19 

19 

49.63 

27.7s 

6.38 

Rur^ 

12 

29.58 

43-30 

1.25 

17 

23-76 

^.18 

9-75 
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TABLE XXIV 

Composite Abitbmetic Calcuutiok Gains by Type School 

Experimental Control 


Type 

Cases 

Mean 

S.D. 

S.E. 

Cases 

Mean 

s. D. 

S. E. 




UNWEIGHTED 




City 

76 

65.43 

43.20 

4.96 

76 

51*05 

38.80 

445 

Campus 

19 

S0.42 

23.10 

5-77 

16 

42.00 

25.90 

6.47 

Rural 

9 

49.00 

32.40 

loRo 

12 

69.50 

38.20 

1. 10 





WEIGHTED 





City 

76 

85.43 

52.95 

6.07 

76 

73.59 

50.55 

5.80 

Campus 

19 

67.1s 

38.70 

8^9 

16 

48.62 

38.70 

9.67 

Rural 

9 

68.66 

34.60 

11.53 

12 

81.0S 

47.30 

1.36 


TABLE XXV 

Composite Arithmetic Problem Gains by Type School 

Experimental Control 


Type 

Cases 

Mean 

S. D. 

s.e; 

Cases 

Mean 

S. D. 

S. E. 




UNWEIGHTED 




City 

107 

9.22 

16.60 

1.60 

109 

10.00 

21.12 

2.03 

Campus 

22 

15.36 

18.00 

3.83 

18 

13.80 

19.00 

4.48 

Rural 

16 

11.94 

30.00 

448 

18 

8.20 

31.00 

7.31 





WEIGHTED 





City 

107 

16.37 

29.34 

2^3 

109 

14.69 

26.85 

2.57 

Campus 

22 

26.13 

23.70 

S.OS 

18 

20.89 

3375 

7.95 

Rural 

16 

21.18 

19.70 

4.64 

18 

24.28 

23.20 

S.47 


The reliability of the difference of the gains, given in 
Tables XXVI and XXVII, was calculated according to the 
formula : 


S. E. diff.=: VS. E. av. i* + S. E. av. 2® 
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TABLE XXVI 

Composite Gains by Grades 


Gr. 


3 

4 

5 

Total 


3 

4 

5 

Total 


3 

4 

5 

Total 


3 

4 

5 

Total 


Unweighted Weighted 


Cases 

^Excess 

Ex. 

Excess 

Cont. 

U.of 
tS.E. M.t 

READING 

Excess 

Ex. 

Excess 

Cout. 

S. E. 

Re> 

liabil- 

ity 

ag 

39 

33 

12.92 

5.82 

4.82 

9-74 

4.11 

S-I 5 

71 

100 

83 

23.98 

6.89 

5-73 

10.75 

12.43 

11.63 

74 

84 

68 

101 

1-74 


3-03 

72 

5-41 


7-75 

69 



ARITHMETIC 

PROBLEM S 




33 

57 

SS 

3.91 

I.OO 

3-73 

3-44 

3.35 

3.23 

85 

86 
62 

355 

389 

S.09 

5.63 

5.04 

5-42 

82 

76 

76 

145 

.91 


244 

65 



3.21 

72 


ARITHMETIC CALCULATION 




27 

40 

37 

15.03 

6.83 

8.60 


8.69 

8.70 
4-50 

78 

97 

11.55 

4-45 

14.92 


8.52 

759 

9.23 

90 

72 

93 

104 

9-58 


5-09 

96 

10.03 


7.01 

is 




SPELLING 





35 

51 

43 

.60 

■35 

7.21 

5-03 

3-56 

4.01 

55 

54 

96 

2.71 

2.13 

8.g8 

7-31 

5-39 

5-97 

6s 

65 

92 

129 


2.46 

2.50 

is 


3.08 

3-74 

74 


* Excess Ex.— Number of points, mean gain of experimental group exceeded 
that of control. 

Excess Conts^Number of points, mean gain of control group exceeded that of 
experimental 

T S. £.— Standard error of the difference. 

% U. of M.— Unreliability of the Measure— chances in 100 that the true difference 
or excess gain is greater than o. 
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TABLE XXVII 

Composite Gains by Type Schools 


Unweighted Weighted 



t 

A 

^Excess Excess 


U. of 

1 

Excess 

A 

Excess 


■■ — \ 
Re> 

Type 

Cases 

Ex. 

Cont. 

tS.E. 

M.t 

Ex. 

Coot. 

S.E. 

liabil* 

ity 





READING 




City 

8s-E 

1.24 


3-37 

64 

4-S7 


10.56 

66 

8i-C 









Campus 

lo-E 


5.58 

10.56 

70 


745 

19-33 

6s 


12-C 









Rural 

6-E 

8.46 


8.14 

84 

25-38 


20.80 

88 


8-C 











ARITHMETIC PROBLEMS 




City 

107-E 


.78 

2.58 

62 

1.68 


382 

66 


log-C 









Campus 

22-E 




60 






18-C 

1.56 


5-89 

S.24 


9.41 

71 

Rural 

16-E 










18-C 

3.74 


8,58 

66 


3.10 

7.18 

66 



ARITHMETIC CALCULATION 




City 

76-E 





11.84 




76-C 

14-38 


6.66 

98 


8.37 

92 

Campus 

19-E 










16-C 

8.42 


8.66 

84 

18.53 


13.13 

92 

Rural 

9-E 







86 


12-C 


20.50 

lo.8s 

97 


12.42 

10-59 





SPELLING 





City 

98-E 



2.65 







93-C 


3.3s 

88 


6.72 

3-93 

96 

Campus 

19-E 








19-C 

•59 


7-23 

53 

S-47 


9-59 

72 

Rural 

12-E 








I7-C 

1.86 


9.64 

S8 

S.82 


9.83 

59 


* Excess £x.^Nuinber of points, mean gain of experimental group exceeded 
that of control. 

Excess Cont.~Number of points, mean gain of control group exceeded that of 
experimental 

f S. E.— Standard error of the difference. 

t U. of M. — Unreliability of the Measurp—chanccs in too that the true difference 
or excess gain is greater than o. 
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Comparative mean gains of experimental and control 
groups are shown by grades in Figfures 19, 20, 2r, and 22 
and by type school in Figures 23, 24, 25, and 26. 

The tables and figures show : 

1. A general agreement between results in the unweighted and the 
weighted scores, there being but two exceptions to this, in the city and 
rural results in arithmetic problems. (Tables XVIII-XXV ; Figures 
19-26.) 

2. That when the pupils are grouped according to grades (Tables 
XVIII, XIX, XX, and XXI; Figures 19, 20, 21, and 22), the balance 
is in favor of the experimental grades in arithmetic calculation and in 
arithmetic problems but in favor of the control grades in reading and 
spelling, while the experimental grades exceed the control in the 
greater number of total instances. 

Arith. Calc. ; Experimental exceeds in 6 ; control, o. 

Arith. Prob. : Experimental exceeds in 4 ; control, 2. 

Reading: Experimental exceeds in 2; control, 4. 

Spelling: Experimental exceeds in 2; control, 4. 

3. That when the pupils are grouped according to type school in 
each subject (Tables XXII, XXIII, XXIV, and XXV; Figures 23, 24, 
25, and 26), the number of instances in which the experimental groups 
exceed the control is greater than the number of instances in which the 
control groups exceed the experimental. 

Arith. Calc.: Experimental exceeds in 4; control, 2. 

Arith. Prob.: Experimental exceeds in 4; control, 2. 

Reading: Experimental exceeds in 4; control, 2. 

Spelling: Experimental exceeds in 4; control, 2. 

4. That the experimental group of Grade 3 shows poorest results 
in arithmetic problem solution and reading; Grade 4 in spelling; Grade 
5 in spelling and reading. 

$. That the experimental group shows the best results in Grade 4, the 
number of instances according to grade in which the experimental 
group exceeds the control being as follows: 

Grade 4; 7. 

Grade 3 : 5. 

Grade 5: 4. 

6. That the experimental group of the city schools shows poorest 
results in spelling, the campus school in reading, and the rural schools 
in arithmetic calculation. The number of instances in which the experi- 
mental group exceeds the control in each of the three groups is as 
follows : 

City: S, experimental; 3, control. 

Campus: 6, experimental; 2, control. 

Rural: 5, experimental; 3, control. 

7. That when the pupils are grouped, regardless of grade and type 
of school, into one experimental and one control group, the balance is 
in favor of the experimental group in reading, arithmetic calculation, 
and arithmetic problem solution, and in favor of the control group in 
spelling. 

8. That in every case the chances are more than even that the 
results in so far as the number of cases is concerned are reliable, 
while by far the greatest reliability is found in the results in arithmetic 
calculation. (Tables XXVI and XXVII.) 
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Percentage of Pupils in Experimental and Control Groups 
Exceeding Average Gain of Combined Experimental and 
Control Groups 

The average of the weighted gains of the combined experi- 
mental and control groups of each grade in each subject was 
computed. The number of pupils in the experimental and in 
the control groups who exceeded the average of the com- 
bined groups was noted by grade and subject and the per- 
centage that this number was of the total was computed. The 
results are shown in Tables XXVIIIa and XXVIIIb. 


TABLE XXVIIIa 

Pupils of Experimental Group Above and Below Average Gains 
of Combined Experimental and Control Groups 


•A TB 
8 ai 


Total 
% 4SS 


Aritb. Calc. 

A 

Aritb. Prob. 

Spelling 

Total all 
Subjects 

A 

B 

A 

B 

A 

B 

A 

B 

S 3 

4 

12 

21 

3 

32 

46 

78 

21 

19 

JS 

42 

29 

22 

90 

97 

22 

IS 

13 

42 

23 

20 

71 

97 

66 

57«9 

48 

40 

27.5 

105 

55 

42.5 

74 

207 

272 


TABLE XXVIIIb 

Pupils of Control Group Above and Below Average Gain of 
Combined Experimental and Control Groups 


Readinir 



3 *3 

4 21 i 8 

« 5 a ^3 so 

Total 47 54 

% 46>5 


Aritb. Calc. Aritb. Prob. 



22 5 13 20 

20 . 20 14 43 

16 21 II 44 

58 46 38 107 

50.9 26.2 


Spelling 

6 29 

30 21 

22 21 

58 71 

44>9 


Total all 
Subjects 

A 

54 70 

85 102 

62 106 

202 278 


* A— Above average of combined experimental and control groups, 
t B—Below average of combined experimental and control groups. 



The results 'indicate that in seven instances the experi- 
mental pupils exceed the average gain of the combined experi- 
mental and control groups of any one grade; in four in- 
stances the pupils of the control group exceed; and in one 
instance the numbers of pupils in experimental and control 
groups who exceed are equal. 

When all grades are combined by subject, the number of 
experimental pupils exceeding the average gain of combined 
experimental and control groups is greater in arithmetic cal- 
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(^Ration and arithmetic problem solution, while the number 
of control pupils exceeding the combined average is greater 
in reading and spelling. The greater difference in results is 
shown in arithmetic calculation, in which 57.9 per cent of the 
experimental pupils exceed against 50.9 per cent control. It 
will be further noted that in arithmetic calculation the num- 
ber of pupils in each grade who exceed the combined average 
gain is gr'eater in the experimental than in the control. 

When all subjects are combined and the results computed 
by grade, the number of pupils who exceed the combined 
average is greater in Grades 4 and 5 in the experimental 
group and in Grade 3 in the control group. 

When all pupils are combined by grade and subject, the 
number of those exceeding the combined average gain is 
greater in the experimental than in the control. 

Pebcentage of Pupils in Experimental and Control Groups 
Who Gain 

The number of pupils who made gains in the weighted 
composite results by grade and subject was noted and the 
percentage this number was of the total experimental group 
and of the total control group was computed. The results 
are shown in Table XXIX. 

When computed by grades in each subject, the experi- 
mental groups exceed in five instances, the control in three, 
while the results are the same in four instances. 

When the totals are computed for each subject, the experi- 
mental groups exceed in arithmetic calculation and arith- 
metic problem solution, while the control groups exceed in 
reading and spelling. 

When the totals are computed by grades regardless of sub- 
ject, the experimental exceeds in Grade 4 while the control 
exceeds in Grades 3 and 5. 

Summary. — ^The gains of the experimental groups exceed 
in a greater number of instances than do those of the control 
group when the gains are measured by single tests. When 
the pupils are grouped in individual classes, the experi- 
mental exceed 76 times and the control 43 times; when the 
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TABLE XXIX 

Fescent of Pupils ik Expebimental and Cohtkol Gboups 
WhoGais 


Experimental Control 


Grade 

Num. Gain 

■ . 4 

Total 

% 

Ntim. Gain 

Total 





EEASING 




3 

29 

29 

100 

29 

29 

100 

4 

39 

39 

100 

35 

39 

89-7 

5 

24 

33 

72.7 

30 

33 

90-9 

Total 

93 

tot 

90.9 

94 

lot 

93-1 




spelung 

• 



3 

33 

35 

942 

34 

35 

92.9 

4 

4 S 

SI 

88.2 

45 

SI 

88.2 

5 

38 

43 

88.3 

41 

43 

95-6 

Total 

ii6 

129 

89.9 

120 

129 

93-0 



AKITHMEnC CALCULATION 



3 

27 

27 

100 

26 

27. 

96.3 

4 

36 

40 

90 

36 

40 

SO 

S 

35 

37 

94-6 

35 

37 

94-6 

Total 

98 

104 

94-2 

97 

104 

93-2 



arithmetic problems 



3 

29 

33 

87.8 

31 

33 

93-9 

4 

45 

57 

78.9 

45 

57 

78.9 

5 

38 

55 

69.1 

33 

55 

60.0 

Total 

113 

145 

77-9 

109 

145 

7 S-I 




GBADE 3 




Reading 

29 

29 

100 

29 

39 

100 

Spelling 

33 

35 

94-2 

34 

35 

92.9 

Ar. Calc. 

27 

27 

100 

26 

27 

96-3 

Ar. Prob. 

29 

33 

87.8 

31 

33 

93-8 

Total 

118 

124 

9 S-I 

120 

124 

96.7 




GBADE 4 




Reading 

39 

39 

100 

35 

39 

89.7 

Spelling 

45 

SI 

88.2 

45 

SI 

88.2 

Ar. Calc. 

36 

40 

90 

36 

40 


Ar. Prob. 

45 

57 

78.9 

45 

57 


Total 

165 

187 

88.2 

161 

187 

K.I 




GBADE 5 




Reading 

24 

33 

73.7 

30 

33 

90.0 

Spelling 

38 

43 

88.3 

41 

43 

95-6 

Ar. Calc. 

35 

37 

94-6 

35 

37 

94-6 

Ar. Prob. 

38 

55 

69.1 

33 

55 

60.0 

Total 

136 

168 

80.9 

139 

168 

82.6 
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classes are grouped in grades, the experimental exceed 22 
times and the control 8 times ; when the classes are grouped ’ 
according to type school, the experimental exceed 18 times 
and the control 12 ; when all pupils are grouped in one experi- 
mental and one control group, the experimental group exceeds 
8 times and the control 2 times. 

The gains of the experimental group exceed in a greater 
number of instances than do those of the control group when 
the gains are measured by composites (weighted and un- 
weighted) of the tests in the four subjects — reading, spell- 
ing, arithmetic calculation, and arithmetic problem solution. 
When the classes are grouped into grades, the experimental 
exceed 14 times and the control exceed 10 times; when the 
classes are grouped according to type school, the experi- 
mental exceed 16 times and the control 8 times; when all 
pupils are grouped in one experimental and one control group, 
the experimental group exceeds 6 times and the control 2 
times. It is thus seen that when the results are judged merely 
by the number of instances in which the experimental or the 
control group exceeds, the balance in each of the different 
groupings is in favor of the experimental group. 

The results of the experimental group are slightly better 
in the 4th grade than in the 3rd and 5th. When measured 
by single tests, the experimental group exceeds 7 times in 
Grade 3, 8 times in Grade 4, and 7 times in Grade 5. When 
measured by weighted and unweighted composites, the ex- 
perimental group exceeds 4 times in Grade 3, 6 times in 
Grade 4, and 4 times in Grade 5. 

The differences in the results according to type school 
situations are very slight. When measured by single tests, 
the city groups exceed 5 times, the campus groups 6 times, 
and the rural groups 5 times. When measured by weighted 
and unweighted composite scores, the city groups exceed 5 
times, the campus groups 6 times, and the rural groups 5 
times. The order of success is, therefore, campus, city and 
rural, though the differences are too slight to make this of 
much significance. 

The results are summarized in Table XXX. 
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TABLE XXX 


Kumser of Times Experimektai- axd Control Grocfs Excess ik 
Average Gain When Reslxts are MEAsrsED by Single Tests 
ANB BY Weighted and Unweighted Composites, Pupils Grol'ped 
BY Grade, Type Schools, and in Total Experiicextal and 
Control Groups 


Subject 


Rcad^ 
Spelling 
Ar. Calc 
At. Prob. 


Grade 3 


Grade 4 


*Ex.Ex. CEx. Ex.E, C Ex. 
AVERAGE GAISS SIXCtE TESTS 

8172 
3 3 3 3 

9054 


Grades 

Ex-E^r C.E:L 


3 0 

I I 

3 O 

I I 


AVERAGE GAIKS WEIGHTED 

Reading 2 4 

Spelling 2 4 

Ajr. Calc. 6 o 

At. Prob. 4 2 


and unweighted composites 

4220 

4202 

4220 

4220 


* Ex. Ex. — Experixnestaj exceeds. 
C. £x.-^stroI exceeds. 


Table XXX indicates that the most consistent gain, mea- 
sured both by single test and composite test scores were made 
in arithmetic calculation, while Table XXVI indicates that 
these gains were likewise the most reliable. The least satis- 
factory results made by the experimental group were found 
in spelling, the experimental and control groups being equal 
in the number of excess gains made in single tests and the 
balance being in favor of the control in the composite results. 
In reading, the balance is strongly in favor of the experi- 
mental group in the single test results and fairly so in the 
composite results. In arithmetic problem solution this last 
condition is reversed, the balance being in favor of the ex- 
perimental group in the composite results, while in the single 
test results the balance is in favor of the control. It will be 
noted that in no case is the balance consistently in favor of 
the control group, but that in two cases, strongly so in the 
case of arithmetic calculation and fairly so in the case of 
reading, the balance is in favor of the experimental group. 

When the results are studied in terms of the percentage of 
pupils in experimental and control groups who exceed the 
average weighted composite gain of the experimental and 
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control groups combined, the foregoing results are corrobo- 
rated in so far as the experimental grades exceed the control 
in 7 as against 4 instances ; in that the highest percentage of 
pupils exceeding in the experimental group is made in arith- 
metic calculation ; and in the fact that the highest percentage 
exceeding in the experimental group when the pupils are 
grouped by grade is in Grade 4. 

When the results are studied in terms of the percentage 
of pupils in the experimental and control groups who gain, 
the experimental exceed the control in the greater number 
of instances: Experimental exceed 5 times, control exceed 
3 times, and results are identical in 4 instances. Again, the 
experimental group exceeds in arithmetic calculation and 
problem solution, while the control exceeds in reading and 
spelling. Again, also, the excess gain is made by the experi- 
mental group in Grade 4, the control group exceeding in 
Grades 3 and S- 

It would thus seem that in every measure used, the results 
favor the experimental group in arithmetic calculation in so 
far as subject is concerned and favor Grade 4 in so far as 
grade is concerned. In no other subject and in neither of the 
other grades are the results so consistent. In no case are 
consistent results found in favor of the control group. 
Furthermore, in general, excess gains are found in favor of 
the experimental groups. While the tables and figures of this 
chapter indicate that the differences in gains made by the 
experimental and control groups are not large, the balance 
on the whole favors the experimental group. 

2. SUBORDINATE CRITERION : THE SUCCESS OF THE 
STUDENT TEACHER 

The teaching success of the students was measured by the 
final student teaching grade. This grade is assigned by the 
director of student teaching and is based upon the reports 
made to him by the training teachers, various normal school 
instructors who supervise the students, and upon his own 
observation. The grade is expressed on a scale of i to 7, 
I being the lowest and 7 the highest grade assigned. 



100 


THE RESULTS 


Distributions of the student teaching grades of the e(}uatcd 
groups of students were made. The results were as follows : 



Expenmental 

Control 

City Students 

Mean 

506 

5.03 

S. D. 

1.28 

140 

Cases 

31 

31 

County Students 

Mean 

5-45 

4-95 

S. D. 

2.15 

1.28 

Cases 

20 

20 

Total Students 

Mean 

5.22 

S-OO 

S. D. 

I.OO 

I. 3 S 

Cases 

SI 

SI 


The distributions for the above are shown in Figutes 27, 
28, and 29. While the differences are slight, in each case the 
difference is in favor of the experimental group. 
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Figube 28. — Final student teacher rating of 20 experimental and ^ 
control rural students. 
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Figure 29. — ^Final teacher rating of all student teachers: 51 experi- 
mental and SI control. 


n 



CHAPTER IX 

The Measurement of Variables 

I. IN RELATION TO GAINS MADE BY PUPILS 

The Relation of Gains to Initial Status. — ^The correlation 
was computed by the product-moment formula between the 
initial status in the weighted composite scores in each subject 
and the gains of the experimental and control groups of each 
grade. The results (Table XXXI) indicate that on the 


TABLE XXXI 

COHBELATION BETWEEN INITIAL STATUS IN WEIGHTED COMPOSITE 

Scores and Gains of Experimental and Control 
Groups of Each Group 

Grade 3 Grade 4 


E C E C 



•c 

r 

* P. E. 

r 

P. E. 

•C ''t 


P. e'. r 

p.e’. 

Readioff 
Aritb. Cal. 


—•IS 

.I 2 SS t — .50 

.1248 

39 “ 

-.21 

.1079 —39 

.1072 

27 

— .34 

.1295 

•34 

.1305 

40 — 

.37 

.Z066 — .22 

.lOtt 

Aritb. Prob. 

33 

—,14 

.1174 

—•14 

.180X 

57 t— 

•44 

.0890 t — .34 

.0890 

Spelling 

35 

.19 

.1140 

—.223 

.1086 

SI 

.102 

.0938 —.07 

'O944 

Av. by 
Grades 

124 

—.08s 

.0603 

—.131 

.0543 

187 1— 

.179 

•0477 t— .131 

.0484 




Grade 5 



Average by Subjects 




E 


c 


E 


c 


•c 

r 

p. e'. 

r 

P.E.’ 

•c 7 


P. E.’ r 

P.Ei 

Reading 

33 

—.23 

.1174 

—.25 

.1166 

lOI t— 

.197 

.0634 t — .35 

..058 

Aritb. Cal. 

37 

.01 

.ziq6 

— .10 

.1106 

104 — 

»*7 

.0847 —.007 

.0661 

Aritb. Prob 

. 55 

.26 

.0011 

— .11 

.0902 

145 — 

.08 

.055 t— .IS 

.1546 

.058 

Spelling 

43 

.108 

.1018 

—.10 

.1032 

129 

.048 

.059 —.131 

Av. by 
Grades 

168 

.037 

.0519 

—.14 

•<VS 6 






* C.— Cases. 

t — Reliable coeflBcients. 

whole the coefficient is low and unreliable. As judged by the 
relative size of the coefficient and P. E. of the 40 coefficients 
calculated, but 8 can be considered reliable. 
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In the experimental group there are 7 positive and 12 nega- 
tive coefficients, while in the control group there are i posi- 
tive and 18 negative coefficients. In 14 instances the coeffi- 
cients of the experimental group are higher, in 4 those of the 
control are higher, and in i instance the coefficient is the 
same. Furthermore, the average of the coefficients of the vari- 
ous subjects is higher in the experimental than in the con- 
trol in each of the three grades and is higher for 3 of the 4 
subjects when the pupils are massed in one experimental 
and one control group in each subject. 


JVCiUllllg 

Arith. Calc. 

-Arith. Prob. 
Spelling 
Grade 3 
Grade 4 
Grade S 

Total by grades - 
Total by subject- 


-Experimental 

-Experimental 

-Experimental 

-Experimental 

-Experimental 

-Experimental 

-Experimental 

-Experimental 

-Experimental 


higher 

higher 

higher 

higher 

higher 

higher 

higher 

higher 

higher 


3 times ; 
I time ; 

1 time ; 

3 times ; 

2 times ; 

2 times ; 

4 times ; 

3 times ; 


control, 

control, 

control, 

control, 

control, 

control, 

control, 

control, 

control. 


0 time. 
2 times. 

1 time. 

0 time. 

1 time. 

2 times. 
0 time. 

0 time. 

1 time. 


In general, there is a greater degree of correlation between 
initial status and gains in the experimental than in the con- 
trol groups. The experimental and control groups differ in 
the relative relationship between the gains and initial status 
of the 4 subjects tested and in the relative relationship be- 
tween initial status and gains in the 3 grades. Not much 
importance can be attached to these results, however, because 
of the low reliability indicated. 

In commenting upon the effect of errors of measurement 
on the correlation of initial status with gains, Godfrey H. 
Thomson says : 


“As Thorndike showed in a recent article, if there is no real correla- 
tion between an initial value of some essential function and its gain 
over a certain period, then because of errors of measurement, there 
will appear to be a negative correlation between these quantities as 
measured. And for the same reason, any real correlation there may 
be, will be reduced in the measurement.” ‘ 

Thomson proposes the following formula as a correction 
for errors of measurement when initial status is correlated 
with gains : 


’ Thomson, Godfrey H. “A Formula to Correct for the Effect of 
Errors of Measurement on the Correlation of Initial Values with 
Gains,” Journal of Experimental Psychology, VII, No. 4, 1924. 
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rxt)+ ( I — rx) 



'Jrx\<iy' — ax-(i — rx) — o’s»(i — r*)} 

a— true initial value 
g — true gain 
ag — true final value 

rx — reliability coefficient of initial value 
rs — reliability coefficient of final value 
X — measured initial value 
y — measured gain 
z — measured final value 

Since the formula calls for the use of reliability coeffi- 
cients, effort was made to obtain all available reliability coeffi- 
cients of the various tests used. The data on the reliability of 
these tests (except Stanford Achievement Test) are scanty. 
The coefficients are not the best one would desire, but are 
the best approximations that the writer could obtain by a 
reasonable expenditure of time. The reliability found for 
the composite scores is indicated in Table XXXII. 

Using the reliability coefficients thus derived for values r* 
and Tz and substituting the other values in Thomson’s formula, 
the raw coefficients between Initial Status and Gains of 
Table XXXI were corrected and the coefficients of Table 
XXXIII were found. 

The first difference to be noted between the raw and the 
corrected coefficients is a slight increase in reliability. While 
but 8 of the raw coefficients can be considered reliable, 14 
of the corrected coefficients can be considered reliable. 

The number of negative coefficients is reduced in both 
groups, but markedly so in the control group : Experimental, 
14 positive and 5 negative coefficients; control, 14 positive 
and 5 negative coefficients. 

In 13 instances, the coefficients of the experimental group 
are higher and in 6 instances the coefficients of the control 
group are higher. When the coefficients are averaged by 
grades, in 2 of the 3 grades the coefficients of the experi- 


Tag 

in which : 
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TABLE XXXII 

Reliabiuty Coefficients of the Various Tests and the Weighted 
Mean Reliability Coefficients of the Composites 


BEADING 


Grade 

Stanford 

Tfaorodike McCall 

Monroe 

Weighted Mean 

3 

•93 

•84 

•73 

.88 

4 

•93 

•75 

.64 

.84 

S 

•91 

.69 

•55 

•89 



ARITHMETIC CALCULATION 


Grade 

Stanford 

Monroe 

Courtis 

Weighted Mean 

3 

•91 

•75 

•75 

•83 

4 

.91 

•75 

•75 

.84 

S 

•87 

•75 

•75 

.81 


ARITHMETIC PROBLEM SOLUTION 


Grade 

Stanford 

Buckingham 


Weighted Mean 

3 

.86 

.80 


•84 

4 

.87 

.80 


.85 

5 

.88 

.80 


•8S 



SPELLING 



Grade 

Stanford 

Morrison McCall 


Weighted Mean 

3 

•89 

.80 


.86 

4 

.89 

e80 


.86 

5 

•91 

.80 


•87 



INZELLIGENCB 



Grade 

Illinois 

Trabue 


Weighted Mean 

3 

•77 

.81 


•79 

4 

•79 

.84 


.82 

5 

.84 

•84 


.84 
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8. 

z 

Ul 

•51 
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mental group are higher ; when averaged by subjects in 3 of 
the 4 subjects the experimental group is higher: 


Reading 
Arith. Calc. 

Arith. Prob. 
Spelling 
Grade 3 
Grade 4 
Grade s 

Total by grades - 
Total by subjects- 


-Experimental 

-Experimental 

-Experimental 

-Experimental 

-Experimental 

-Experimental 

-Experimental 

-Experimental 

-Experimental 


higher 

higher 

higher 

higher 

higher 

higher 

higher 

higher 

higher 


2 times ; 

1 time; 

3 times ; 
3 times : 
3 times; 
3 times; 
3 times ; 

2 times; 

3 times ; 


control, 

control, 

control, 

control, 

control 

control, 

control, 

control, 

control. 


1 time. 

2 times. 
0 time. 

0 time. 

1 time. 

0 time. 

1 time. 

I time. 

I time. 


Correcting the coefficients raised them on an average of 
.254 points in the experimental and .247 points in the control 
groups. The minimum increase in the experimental group 
was .06 points and the maximum increase was .58 points. 
The minimum increase in the control group was .11 points 
and the maximum, .62 points. 

As in the case of the raw coefficients, there is a greater 
degree of correlation between initial status and gains in the 
experimental than in the control groups. Again, the experi- 
mental and control groups differ in the relative degree of cor- 
relation between the gains and initial status of the 4 sub- 
jects and in the relative degree of correlation between initial 
status and gains in the 3 grades. While there is some varia- 
tion in the results of the raw and the corrected coefficients, in 
general the relative standing of the experimental and the 
control groups remains the same. It is interesting to note 
that the only instance in which the control group exceeds the 
experimental is in the case of arithmetic calculation, the sub- 
ject in which the gains are most consistently in favor of the 
experimental group. 

While the reliability of the corrected coefficients is higher 
than that of the raw coefficients, it must be remembered that 
but 14 of the 38 coefficients are large enough to indicate any 
positive or negative correlation. Of these 14 significant co- 
efficients, however, the 9 significant coefficients of the experi- 
mental group exceed those of the control group, while of the 
5 significant coefficients of the control group, but 3 exceed 
those of the experimental group. 



no 


THE MEASUREMENT OF VARIABLES 


The Relation of Gains to Mental Age 

Coefficients of correlation were computed between weighted 
composite gains in each subject by grades and mental age, 
the mental age being the average of the Trabue Mentimeter 
and the Illinois Intelligence Examination. Data for correc- 
tion of the raw coefficients were not available and, therefore, 
the results must be interpreted with the limitations of the 
uncorrected coefficients in mind. The results presented in 
Table XXXIV indicate generally low and unreliable coeffi- 
cients, but 7 of the experimental and 2 of the control reach- 
ing a standard of reliability, while 6 of the experimental 
and 3 of the control are negative. The coefficients of the 
experimental groups exceed those of the control in ii in- 
stances, while those of the control exceed the experimental 
in 8 instances. When the pupils are grouped by grades with 
all subjects combined, the coefficients of the experimental 
group are greater in Grades 4 and 5, while that of the control 
is greater in Grade 3. When all the grades are combined by 
subject, the coefficients of the experimental group are greater 
in reading and arithmetic problems, while those of the con- 
trol are greater in arithmetic calculation and spelling. 

Reading — Experimental higher 2 times ; control, i time 
Ar. Calc. — Experimental higher 2 times ; control, l time 
Ar. Prob. — Experimental higher 2 times ; control, i time 
Spelling — Experimental higher l time; control, 2 times 
Grade 3 — Experimental higher i time ; control, 3 times 
Grade 4 — Experimental higher 3 times ; control, i time 
Grade S — Experimental higher 3 times ; control, i time 
Total by 

grades — Experimental higher 2 times; control, i time 
Total by 

subjects — Experimental higher 2 times ; control, 2 times 


The Relation of Gains to Mental Age with Chronological 
Age Constant 

The relation between weighted gains and mental age with 
chronological age constant in the various subjects and grades 
was computed according to the formula for partial correlation : 
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Va — 

in which 

ra = coefficient of correlation between mental age and gains. 

ra = coefficient of correlation between mental age and chron- 
ological age. 

rs3 = coefficient of correlation between gains and chronological 
age. 

ria.s = coefficient of correlation between mental age and gains 
with chronological age constant. 

The correlation between mental age and chronological age 
is shown in Table XXXV. The results, in general, show 
low, negative, unreliable coefficients. In the experimental 
group there are 2 positive and 17 negative coefficients, while 
in the control group there are 6 positive and 13 negative co- 
efficients. In the experimental group, ii coefficients might 
be considered reliable, while in the control but 6 might be 
considered reliable. The significant thing to be noted is that 
in but one case the coefficient in the experimental group is 
higher than in the control. Since so many of the results 
are negative, the higher coefficients of the control group can 
be interpreted to indicate less disparity between mental and 
chronological ages than in the experimental group. 

The correlation between chronological age and gains is 
shown in Table XXXVI. The coefficients are generally low 
and unreliable. In the experimental group there are 4 posi- 
tive and 15 negative coefficients, while in the control group 
there are i positive and 18 negative coefficients. In ii in- 
stances, the coefficients of the experimental group may be 
considered reliable and in 9 instances those of the control 
group may be considered reliable. In 12 instances, the coeffi- 
cients of the experimental group exceed those of the control, 
and in 7 instances the coefficients of the control exceed those 
of the experimental. The coefficients of the experimental 
exceed the control in the entire group in reading and arith- 
metic problems, while those of the control exceed in arith- 
metic calculation and spelling. The coefficients of the experi- 
mental are greater in Grades 3 and 4, while those of the con- 
trol are greater in Grade 5. It would seem that on the whole. 



TABLE XXXV 

CORBELATION BETWEEN MENTAL AgE AND ChKONOLOGICAL AgE OF EXPERIMENTAL AND CONTROL GROUPS IN EACH "GRADE 
Grade 3 Grade 4 Grade s Average by aubjecta 



radea ia4 —.033 .0600 .rag .0486 1B7 t'i49 -04^5 .no .1^13 168 .13a .0513 .09a .0539 

*C. — Cases, t Reliable coefficients. 
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the factor of age has had somewhat more influence on the 
results of the experimental than on those of the control group. 

The correlation between mental age and gains with chrono- 
logical age constant is shown in Table XXXVII. The re- 
sults indicate generally low and unreliable coefficients. In 
the experimental group there are 13 positive and 6 negative 
coefficients, while in the control group there are 15 positive 
and 4 negative coefficients. Six of the experimental and 6 
of the control coefficients can be considered reliable. The 
coefficient of the experimental group is greater in 9 cases 
and that of the control group is greater in 10 cases. When 
grouped regardless of subject according to grade, the coeffi- 
cient of the experimental group is greater in Grades 4 and 5 
and that of the control in Grade 3. When grouped by sub- 
ject, the coefficient of the experimental is greater in reading, 
while the coefficient of the control is greater in arithmetic 
calculation, arithmetic problem solution, and spelling. 

Reading — Experimental higher 2 times ; control, 1 time 
Ar. Calt — Experimental higher i time ; control, 2 times 
Ar. Prob. — Experimental higher 2 times ; control, 1 time 
Spelling — Experimental higher i time ; control, 2 times 
Grade 3 — Experimental higher i time ; control, 3 times 
Grade 4 — Experimental higher 2 times ; control, 2 times 
Grade S — Experimental higher 3 times ; control, i time 
Total by 

grades — Experimental higher i time; control, 2 times 
Total by 

subjects — Experimental higher i time ; control, 3 times 

When the influence of chronological age is removed, the 
factor of mental age bears a somewhat greater relationship 
to gains in the control than in the experimental group. It has 
been shown (i) that the correlation between mental age and 
gain is greater in the experimental group; (2) that the cor- 
relation between chronological age and gain is negative but 
nearer zero in the experimental; (3) that the correlation 
between mental age and chronological age is negative but 
nearer zero in the control ; (4) that the correlation between 
mental age and gain with chronological age constant is slightly 
greater in the control. 
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The Relation of Gains to Amount of Time Given to 
Test-Determined Instruction 

Correlations by the rank method (Spearman’s Rank Dif- 
ference) were computed between the gains made in each test 
and the amount of time given to test-determined instruction 
in each subject by the various experimental classes. The 
results are shown in Table XXXVIII. 


TABLE XXXVIII 

Correlation between Time and Gains Made in Separate Tests 
BY Individual Experimental Classes 


Time and 

No. Gasses 

r 

Reading : 

Stanford 

12 

.124 

Thorndike McCall 

22 

-.158 

Monroe 

12 

— -541 

Average 


— .191 

Arithmetic Calculation: 

Stanford 

12 

.158 

Monroe 

12 

.158 

Courtis 

12 

— .018 

Average 


.099 

Arithmetic Problem Solution : 

Stanford 

12 

— .071 

Buckingham 

12 

-•354 

Average 


-.213 

Spelling : 

Stanford 

12 

.141 

Morrison McCall 

12 

.642 

Average 


.381 


Table XXXVIII indicates that there is little relation be- 
tween the amount of time spent on test-determined instruc- 
tion by the various experimental classes and the gains made 
in separate tests. The small number of cases — 12 classes — 
gives little significance to these results. The order of rela- 
tionship between time and gain from high to low is as follows : 

1. Spelling — ^Av. r .381 

2. Ar. Calc. — Av. r .099 

3. Reading — Av. r — .191 

4. Ar. Prob. — ^Av. r —.213 

The relation between time spent in test-determined in- 
struction and gains made in weighted composite scores when 
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pupils are grouped according to grade and type school situa- 
tions is shown in Table XXXIX. This table was derived 
from Tables XIV and XV (Chapter VII) and Tables XXVI 
and XXVII (Chapter VIII). From Tables XIV and XV 
were obtained the rank in amount of time expended on ex- 
perimental instruction by the various type schools and the 
various grades respectively. From Tables XVI and XVII 
were obtained the rank in order of gain made by the experi- 
mental groups as compared with the control groups by the 
various type school situations and by grades respectively. 


TABLE XXXIX 


Comparison of Time Expended on Test-Determined Instruction 
WITH Gains Made in Composite Weighted Scores when 
Pupils Are Grouped According to Grade and Type School 
Situation 


Grade 

3 

4 

5 


Reading 
■ *■— “ \ 
Oain Time 

3 3 

I 1 

a a 


Spelling 

Gain Time 

1 1 

2 2 

3 3 


Artth. Calc. Arith Prob 

t ' ^ \ 

Gam Time Cam Time 

2 3 3 3 

3 12 2 
12 11 



City 

Campus 

Rural 


2 

3 

I 


N 


3 3 I I 2 

1 2 2 2 1 

2 13 3 3 

B —All figures in table indicate rank 


3 

2 

I 


3 

1 

2 


Table XXXIX shows perfect agreement in rank m com- 
parative gain in reading, spelling, and arithmetic problem 
solution with amount of time spent in test-determined instruc- 
tion when the pupils are grouped according to grade, but no 
such agreement in the case of arithmetic calculation. No 
agreement is indicated between time and gain when the pupils 
are grouped according to type school situation. 

Table XXVI (Chapter VIII) indicates that when all the 
pupils are grouped in one experimental and one control group 
excess gains over the control group are made by the experi- 
mental group in each subject except spelling, the rank being: 
I. Arithmetic Calculation; 2. Reading; 3. Arithmetic Prob- 
lem Solution; 4. Spelling. 
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Table XII and Table XV indicate that the relative amount 
of time directed to be spent on each of the four subjects and 
the relative average time actually spent on these subjects is 
identical, the rank in time for both being: i. Reading; 2. 
Spelling ; 3. Arithmetic Calculation ; 4. Arithmetic Problem 
Solution. No relation, therefore, is indicated between the 
average amount of time spent on the various subjects by the 
experimental group as a whole and the results obtained. 
From all of the foregoing, it is evident that little relation 
between time and gain is shown. 


The Relation of Intelligence, Scholarship, and Chronological 
Age of the Student Teacher to Gains Made by the Pupils 


The averages of the I. E. R. Intelligence scores of the 
junior scholarship grades and of the chronological ages were 
computed for all the students who taught in the experimental 
and the control classes, the averages being indicated accord- 
ing to grade and type school situation. The results are shown 
in Table XL. Since the junior scholarship grades are ex- 
pressed on a different scale for the city and rural students it 
was necessary to indicate them separately. 

It was shown in Chapter VIII (pp. 87-93) that the 
school grades of the experimental group ranked in the de- 
gree to which the best weighted results were obtained as 
follows; I. Grade 4; 2. Grade 3; 3. Grade 5. Table XL 
shows very little difference in average intelligence, scholar- 
ship, or chronological age, except in the case of chronological 
age which is somewhat higher in Grade 3 than in Grades 4 
and 5. The rank within the slight differences shown is not 
in any case identical with the rank of the obtained results, 
the rank of the groups of students assigned to each grade 
being as follows : 


Intelligence 

1. Grade 5 

2. Grade 4 

3. Grade 3 


Scholarship 

t *— \ 

City Rural 

1. Grade 4 i. Grade 3 

2. Grade 5 2. Grade s 

3. Grade 3 3. Grade 4 


Chronological Age 

1. Grade 3 

2. Grade 4 

3. Grade s 



THE MEASUREMENT OF VARIABLES 



»o 

00 

ts 

Ok 



O 

m 

m 

»-* ei o 



in 

to 

d 

In Cl M 

U 



Cl 

M 

*0 N Cl 

o 

u 

N 

Cl 

M 

CS Cl Cl 


<- 





e 

b 






JS 





« 

u 

Ls 

Ov 

>o 

s 

In en ^ 
^ lO ^ 

S 


. ^ ^ to toto \D 

l< 


^ «0«0piju 


\Q (^00 ci 

O TTSO )L 

g 


R R CO ;; 
2. 

S'Sff E 


*5 

_ 




in 

VO 


s? 

' « 

■5 

2? 

5? 

'8 

bo 

< 


Cl 

Cl 

Cl 

b* 

JS 





U 

iti 

9 

s 

>& 


i 

P> N N g 

"S 


, . «2 «200 v> 

> 'VOO ^ «*9 

^ ^ m ^ m ^ tn 


Spvo QOO Nts 

^^Urtu«u 


. . R 00 »n 

■5i> « s 




vovo Ok ii 

OOOOO rt 


»H>o » 3 
«n lO to fl 


•o 

2 to ^ lo 

u 


§.-3 

i?E i J 

Qu(§ S 



ii8 


THE MEASUREMENT OF VARIABLES 


As measured by the difference between the experimental 
and control groups of students in each of these factors, the 
rank is as follows : 


Intelligence 

1. Grade S 

2. Grade 4 

3. Grade 3 


Scholarship 

, * — > 

City Rural 

1. Grade 3 i. Grade 4 

2. Grade 4 2. Grade 3 

3. Grade 5 3. Grade S 


Chronological Age 

1. Grade 3 

2. Grade 5 

3. Grade 4 


Again, there is practically no correspondence between pupil 
results and comparative student status. 

It was shown in Chapter VIII (pp. 87-93) that when the 
pupils were grouped according to type schools, the best results 
were obtained in the Campus School, the city and rural groups 
being identical in the number of instances in which the ex- 
perimental groups exceeded the control. Table XL shows no 
corresponding superiority in the factors measured of the 
students who taught in this situation. The results on the 
whole indicate no relationship between the_ success of the 
pupils and the intelligence, scholarship, and chronological 
age of the student teacher. 


Summary of Study of Variables in Relation to Gains Made 
BY Pupils 

1. There is a greater degree of correlation between initial status 
and gains in the experimental than in the control group, both when 
measured by raw and by corrected coefficients. 

2. There is a greater, degree of correlation between mental age and 
gains in the experimental than in the control group, but when chon- 
ological age is made constant, the relationship is slightly greater in 
the control than in the experimental. 

3. Except when the pupils are grouped according to grade, but little 
relation is shown between gains and amount of time spent in test- 
determined instruction. 

4. No relation is shown between gains made by pupils and the ' 
intelligence, scholarship, and chonological age of the student teachers. 

2 . THE MEASUREMENT OF VARIABLES IN RELATION TO THE 
FINAL RATING OF THE STUDENT TEACHERS 

Correlation was computed between the final student teacher 
rating of the experimental and control groups of students 
and their I. E. R. Intelligence score, their junior scholarship 
grades, and their chronological age. Because of the difference 
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in the scale used, the junior scholarship grades had to be 
treated separately for the city and the rural students. The j 
results are shown in Table XLI. 


TABLE XLI 

Correlation between Final Student Teacher Rating and CERfAiN 
Other Student Factors 




Experimental 



Control 


J; llidl OLUUCiiL X C4ICOCX 

Rating 

f 

Cases r 

P. E. 

Cases 

r 

p.E. 

I. E. R. Intelligence 

SI 

.038 

•0044 

SI 

.035 

.0943 

Jr. Schol. Grades City 

30 

.025 

.1234 

31 

.242 

.1139 

Jr. Schol. Grades Rural 

16 

.Si8 

•1233 

20 

.421 

.1241 

Chronological Age 

SI 

.289 

.0866 

SI 

.144 

.0924 


Table XLI indicates: 

1. That there is greater correlation in the experimental gfoup 
between final teacher rating and intelligence, rural scholarship grades, 
and chronological age than in the control group, while the correlation 
in the control group is greater between final teacher rating and junior 
city scholarship grades. 

2. That the highest correlations obtained, both in the experimental 
and the control groups are between final teacher rating and Junior 
Scholarship Grades Eural. 



CHAPTER X 

The Interpretation of the Data and Conclusions 

I. THE MAIN criterion : THE PROGRESS OF THE PUPILS 

The Results in General. — The problem of the present study 
was stated in the beginning as : The place and value of train- 
ing student teachers to use skilfully the results from general 
and diagnostic tests in the instruction of children. The re- 
sults that have been presented show, in general, a balance in 
favor of the experimental group; that is, that when the 
results are considered in terms of the number of times the 
experimental or the control group showed greater average 
gain without consideration of the subject or test in which 
the gains were made, the pupils taught by students trained to 
use the results of general and diagnostic tests showed greater 
gains when tested than the pupils taught by students not so 
trained. In order to bring the results together for conveni- 
ence in interpreting them, the following summary is offered : 

1. Measured by separate tests, greater gains are made by : 
Experimental — ^76; control — ^43 (classes) 

Experimental — 15; control — 9 (type school) 

Experimental — 2a; control — 4 (grade) 

Experimental — 7; control — i (total) 

(Tables XVIa, b; XVII) 

2. Measured by composite scores, weighted and unweighted, greater 
gains are made by: 

Experimental — 14; control — 10 (grades) 

Experimental — 16; control — 8 (type school) 

Experimental — 6; control — 2 (total) 

(Tables XXVI ; XXVII) 

3. Measured by the number of pupils exceeding the average gain of 
the combined experimental and control groups, the results show: 

Experimental — 7; control — 3; same — l (grades) 

Experimental — 2; control — i (all grades) 

Experimental — 2; control — 2 (all subjects) 

Experimental — i ; control — o (total) 

(Table XXVIll) 

4. Judged by the number of instances in which the number of pupils 
who gain is greater in the experimental or in the control ; 

Experimental — 4; control — 3; same — s (grades) 

Experimental — 2; control — 2 (total) 
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In the first, second, and third measures given above, the 
balance is clearly in favor of the experimental group. In the 
fourth measure — ^the percentage of pupils who gain — ^the 
results are about the same in the experimental and control 
groups. Since the percentage of pupils who gained implies, 
conversely, that certain pupils showed no improvement or, as 
happened in by far the greater number of cases, that some 
pupils in each group made lower scores in the final than in 
the initial test, the results here may well be attributed, in 
part at least, to errors of measurement, enhanced, in the pres- 
ent study, by the small number of cases. The fourth item is, 
therefore, not considered of sufficient significance to out- 
weigh the results of the other three measures. 

As has been shown in the detailed study of results in 
Qiapter VIII, the difference between the gains of the experi- 
mental and the control groups is slight. The smallness of the 
differences is attributable : 

1. To the shortness of the period of test-determined in- 
struction — 19 weeks — this period subject to the many inter- 
ruptions inevitable in the complicated program of the train- 
ing centers. 

2. To the fact that the results of this short period of in- 
struction were measured not by specific tests of the functions 
exercised but by general standard achievement tests. 

Under the above conditions, at best but a trend in one direc- 
tion or the other could be expected. Such trend in favor of 
the experimental group is indicated in the above results. It 
is, therefore, concluded that the number of instances in which 
the gains of the experimental group exceed those of the con- 
trol is indicative of some value in training student teachers 
to use the results of general and diagnostic tests in their in- 
struction of children. 

The influence of the variables of Initial Status and of 
Mental Age upon the results is summarized as follows : 

I. The correlation between initial status and weighted composite 
gains is low but is higher in the experimental or in the control as 
follows : 

a. Uncorrected: 

Experimental higher — ^3; control higher — 0 (grades) 
Experimental higher — 3; control higher — 1 (subjects) 
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b. Corrected: 

Experimental higher — 2; control higher — 0 (grades) 
Experimental higher — 3: control higher — i (subjects) 

(Tables XXXI and XXXIII) 

2. The correlation between mental age and weighted composite gains 
is low but shows higher coefficients in the experimental or the control 
as follows: 

Experimental higher — 2: control higher — i (grades) 
Experimental higher — 2; control higher — 2 . (subjects) 

(Table XXIV) 

3. The correlation between mental age and weighted composite gains 
when chronological age is constant is low but shows higher coefficients 
in the experimental or in the control as follows : 

Experimental higher — 1 ; control higher — 2 (grades) 
Experimental higher — i; control higher — 3 (subjects) 

The results show a slightly higher degree of correlation 
between initial status and gains in the experimental than in 
the control groups. The same thing is true, but to a less de- 
gree, of the correlations between mental age and gains in the 
experimental than in the control groups. A very slightly 
higher degree of correlation between mental age and gains 
with chronological age constant in the control than in the 
experimental is shown. 

While these results itidicatc in a very slight degree that the 
progress made by the pupils of the experimental group was 
more in accord ziith their mental age and their initial status 
in the subjects tested than by those in the control, the co- 
efficients are so low and the differences are so small that no 
conclusion is justifiable. 

The Results According to Subject. — ^The following sum- 
mary of the relative gains made according to subject is 
offered : 

I. When measured hy separate tests, greater gains are made as 
follows : 

a. Arithmetic Calculation: 

Experimental — 24; control — 12 (classes) 

Experimental — 9; control — o (grades) 

Experimental— 5; control — 4 (type school) 

Elxperimental — 3; control — O (total) 
sum — ^41 ; . sum — 16 

b. Reading: 

Experimental — ^27; control — 9 (classes) 

Experimental — 8; control — i (grades) 

Experimental — 7; control — 2 (type school) 

Experimental — 3; control — o (total) 
sum— 45 : sum — 12 
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c. Arithmetic Problems: 

Experimental — ii; control — 12; same — i (classes) 
Experimental — i ; control — S (grades) 

Experimental — 2; control — 4 (type school) 

Experimental — i ; control — 1 (total) 
sum — IS ; sum — ^22 

d. Spelling: 

Experimental — 14; control — 10 (classes) 

Experimental — 3; control — 3 (grades) 

Experimental — 3; control — 3 (type school) 

Experimental — i ; control — 1 (total) 
sum — 21 ; sum — 17 

(Tables XVIa, b ; XVII) 

2. When measured by composite scores weighted and unweighted, 
greater gains are made by : 

a. Arithmetic Calculation: 

Experimental — 6; control — o (grades) 

Experimental — 4; control — 2 (type school) 

Experimental — 2; control — o (total) 
sum — 12; sum — 2 

b. Reading: 

Experimental — 2; control — 4 (grades) 

Experimental — 4; control — 2 (type school) 

Experimental — 2; control — o (total) 
sum — 8; sum — 6 

c. Arithmetic Problems: 

Experimental — 4; control — 2 (grades) 

Experimental — 4; control — 2 (type school) 

Experimental — 2; control — o (total) 
sum — 10 ; sura — 4 

d. Spelling: 

Experimental — 2; control — 4 (grades) 

Experimental — 4; control — 2 (type school) 

Experimental — o; control — 2 (total) 
sum — 6; sum — 8 
(Tables XXVI, XXVIl) 

Ranking the above in order of excess gain, we have : 


1. By single tests: 

1. Reading 

2. Arithmetic Calculation 

3. Spelling 

4. Arithmetic Problems 

2. By composites: 

1. Arithmetic Calculation 

2. Arithmetic Problems 

3. Reading 

4. Spelling 

3. When measured by number of pupils exceeding average gain of 
combined experimental and control groups, the results are ranked as 
follows : 

1. Arith. Calc. Exper., 57.9^ exceed; control, so.glf 

2. Arith. Prob. Exper., 27.$% exceed; control, 26.2)1 

3. Reading Exper., 45.5)< exceed; control, 46.5% 

4. Spelling Exper., 42.^ exceed; control, 44.g!( 

(Tables XXVIIIa and b) 
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4. Measured by the number of instances in which the number of 
pupils who gain is greater in the experimental or control, the rank 
is as follows : 

1. Arith. Calc. Exper., 94.2^; control, 93.2# 

2. Arith. Prob. Exper,, 77.9^; control, 75.1^ 

3. Reading Exper., 90.9^; control, 93.1^ 

4. Spelling Exper., Sg.gl^; control, 93.0^ 

(Table XXIX) 

The rank by single test results is not in agreement with 
the rank by composites nor with the rank of the third and 
fourth measures above. Assuming the greater reliability of 
the composite results and in view of the fact that the rank in 
the third and fourth measures is in agreement with the rank 
of the composites, the latter can be assumed to represent the 
relative success of the experimental group. In each of the 
four main measures — ^gains by single tests, gains by com- 
posites, percentage exceeding average of combined experi- 
mental and control groups, percentage of pupils who gained — 
the most highly consistent gains are made by the experi- 
mental group in arithmetic calculation. A trend in favor of 
the experimental group is shown in reading and arithmetic 
problem solution, but not nearly to so great an extent as in 
arithmetic calculation. In the case of spelling, the results 
favor the control group. 

The various subjects rank in order of degree of relation- 
ship between initial status and gains as follows : 

1. Arith. Prob. — Experimental higher, 3; control, o 

2. Spelling — Experimental higher, 3; control, o 

3. Reading — Experimental higher, 2; control, i 

4. Arith. Calc. — ^Experimental higher, i ; control, 2 

The results here are not in agreement with the results as 
measured by relative gains, since when measured by excess 
gains, the best results in the experimental group were in 
arithmetic calculation, while in the present instance, arith- 
metic calculation is the only subject in which the relationship 
between initial status and gains is greater in the control than 
in the experimental group. The problem is complicated by 
the relative difficulty of making a high score higher in these 
subjects as well as the particular stage of development in each 
when it is most difficult to make a high score higher. For 
instance, it may be more difficult in the fifth grade to make 
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a high score in arithmetic higher than it is to make a high j 
score in reading higher. In the absence of definite knowl- 
edge as to the relative improvability of these subjects in the 
various school grades, and in view of the decided probability 
that such grade differences in improvability exist, the above 
results need not modify the conclusion indicated by the rela- 
tive success of the experimental group in the different sub- 
jects, namely; That when measured in terms of relative 
gains, both in individual test scores and in composite scores 
of the various subjects, the results indicate clearly that there 
is some value in teaching students to use the results of tests 
in arithmetic in their instruction of children, that there is a 
suggestion of such value in the case of reading and of arith- 
metic problem solution, but that no such value is indicated 
by the results in spelling; that in considering this conclusion, 
it must be kept in mind that the period of test-determined in- 
struction was but ig weeks in length and that no conclusion 
is offered as to what might have been the results had the 
experiment been carried over a longer period of time. 

In so far as it is possible to do so with the data at hand, 
attempt will be made to interpret the relative degree of suc- 
cess in the four subjects. The differences in results may be 
due to any one or more of a number of causes some of which 
are analyzable and some of which are not. Some of the possi- 
ble causes of the differences in results, analysis of which will 
be attempted, are : 

1. The relative amount of time spent on the various subjects. 

2. The relative improvability of the subjects. 

3. The relative worth of the test-determined instruction used. 

4. The relative difficulty of the instruction to the students. 

5. The relative degree to which the tests were measures of the 
instruction given. 

Spelling. — At first sight it would seem that spelling is a 
subject which because of its definiteness and comparative sim- 
plicity of method should bring better results in the hands of 
the unskilled student teacher than any other. Instead, with 
an expenditure of next to the highest amount of time, the 
results are the poorest obtained. The bulletins (Chapter VI) 
indicate that the test-determined instruction in spelling had 
the following features : 
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t I. Rousing desire for improvement through records of achievement, 
frequent testing, and establishment of definite goals. 

2. Basing the work on an analysis of the difficulties shown in both 
the initial standard tests and the informal tests given weekly. 

3. Grouping words around types of specific difficulties and varying 
the teaching emphasis according to the difficulty. 

4. Supplementing the work in specific difficulties with words drawn 
from lists based upon common usage either by children or adults, such 
as the list compiled by Homer J. Smith and the " 100 demons.” 

5. Keeping up interest through variety in drills used. 

6. Grouping children according to needs shown. 

(Bulletins 2, 5, 6, lo, 11, 13. 14, I7, 18.) 

The above points conform, in general, to the principles of 
method in teaching spelling outlined by Ernest J. Horn.' 
Greater emphasis was placed, however, in the present study 
upon the grouping of words around type difficulties than Horn 
would seem to advocate in his statement : “ Grouping by type 
of errors seems to have some merit in teaching words selected 
because of their similarity in type of error, but there is a 
tendency to include in such groupings words which need not 
be learned at all." ’ Gates likewise expresses doubt of the 
value of the method in the following statement : “ Groupings 
by similarities of error, especially in review, are sometimes 
effective, but seldom worth the trouble." ° 

In support of the method of grouping about type difficul- 
ties, Tidyman says, “ Grouping according to a common diffi- 
culty is a principle which appears to meet our needs. It is 
fundamentally pedagogical in character and broad enough to 
include all classes of words." * Again, Tidyman cites the fol- 
lowing : " The experimental determination of the value of 
this plan of grouping was made by Dr. Wagner of the Uni- 
versity of Pennsylvania who compared the growth in ability 
of two sixth-grade classes. In one class, the words were 
classified according to a common error and special attention 
was called to the words of the group. In the other class, the 

' Horn, Ernest J. " Principles of Method in Teaching Spelling as 
Derived from Scientific Investigation,” i8th Yearbook, National Society 
for the Study of Education, Part II, pp. 52-71. 

‘ Horn, Ibid., Part II, pp. 52-71. 

’ Gates, A. L. The Psychology of Reading and Spelling with Special 
Reference to Disability, Columbia University, 1922, p. 82. 

* Tidyman, W. F. The Teaching of Spelling, 1919, p. 20. 
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words were presented in a chance order. Tn ten learning les- 
sons the class following the grouping method showed a greater 
gain, amounting to about 20 per cent or i.i times the im- 
provement of the ordinary class as calculated by the author. 
The conclusion is : ‘ Grouping words into lessons according 
to spelling difficulty is better than the ordinary plan of 
spelling lessons. It secures better daily lessons, better final 
results, and greater steadiness or constancy of correct 
spelling.’ ” ’ 

Since the emphasis upon grouping by difficulty determined 
to a large extent the content of the test-determined instruc- 
tion in spelling, the words specified in the bulletins to be 
taught were checked against the final tests given in order to 
determine the extent to which the tests actually tested the 
words taught. It was found that of the 180 words outlined 
to be taught in Grade 3, only i word appeared in the Morri- 
son McCall Spelling Test, Form 4, and but 4 words appeared 
in the Stanford Achievement Test, Primary Examination, 
Form B, as follows: 

Morrison McCall: began 

Stanford : boat 

play 
miss 
read 

Of the 180 words outlined for Grades 4 and 5, but 3 ap- 
peared in the Morrison McCall Spelling Test, Form 4, and 
but 4 appeared in the Stanford Achieement Test, Adanced 
Examination, Form B, Test 9, as follows : 

Morrison McCall : began 
belong 
over 

Stanford : boat 

child 
miss 
play 
read 

It is evident that the tests did not measure ability to spell 
the words taught in the test-determined instruction. The de- 
gree to which the failure of the tests to measure the' worth of 


’ Tidyman, Ibid., p. 16. 
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the instruction is accountable for the comparatively poor spell- 
ing results is dependent upon the extent to which ability to 
spell certain words helps in the ability to spell other words. 
In this connection, Leta S. Hollingworth says : “ English 
spelling is relatively resistant to learning because of the spe- 
cific character of the connections to be made. Very few gen- 
eralizations are possible, each word being to so great an 
extent a special matter.” ‘ 

If English spelling connections are so highly specialized as 
Dr. Hollingworth indicates and as common observation cor- 
roborates, emphasis upon the selection of words in common 
use seems the reasonable basis for determining the content 
of a spelling course. As Courtis has said, “ The basic aim of 
the spelling work is then, not the teaching of the spelling of 
the words of the course, but the development of the ideal of 

not making mistakes in spelling The school must 

make sure that children have perfect control over spelling the 
vital words of the English language (the thousand most com- 
mon words) and they must arouse in the children such a de- 
sire to spell correctly that they will of themselves purpose to 
learn to spell all the other words they may need.” “ 

While no record of the method used in the control classes 
was kept and while the methods used in the different situa- 
tions varied, in general, the Horn-Ashbaugh method was used, 
supplemented by the teaching of other words as needed. In 
neither the experimental nor in the control group was more 
than ordinary emphasis placed upon the visual perception of 
the word, the importance of which is indicated by Gates ’ in 
the correlation of .50 between ability to discriminate between 
small differences between pairs of words and ability to spell. 
In commenting upon this, Homer B. Reed says. “ The close 
dependence of spelling upon perception suggests that the most 
important condition for learning to spell is an accurate and 

'Hollingworth, L. S. Special Talents and Defects, 1923, pp. 125, 
126. 

’ Courtis, S. A. Teaching Spelling by Plays and Games, pp. 4, 5. 

’ Gates, Arthur I. The Psychology of Reading and Spelling, 1022, 
P. 31 . 
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Strong impression of the letters of the worrl. This may be ^ 
acquired by adequate repetition and vivid presentation. 
Therefore, any method or device of teaching spelling that 
would increase either the frequency or the vividness of the 
presentation should help in improving ability to spell.” ‘ 

The main point of difference between the method used in 
the experimental group and that of the control was the em- 
phasis placed in the former upon grouping according to type 
difficulties. The results obtained are in agreement with the 
position of Gates and of Horn ; i. e., that grouping spelling 
words according to type difficulty is of doubtful worth. The 
basis of selection of the spelling words unduly limited the 
character of the words taught and, since the ability to spell 
one word seems to have little power to affect the ability to 
spell other words and since, further, so few of the words 
taught actually occurred in the final tests given, the failure 
of the experimental group to make superior gains can be 
explained primarily upon the basis of a too-limited content. 
To make the conclusion sufficiently sound it would be neces- 
sary, of course, to have a check of the words actually taught 
in the control group against the final test given. Since this 
cannot be done, the conclusion could rest upon the assumption 
that a richer content of the course in the control group gave 
greater probability that more of the words taught appeared 
in the final tests. 

The above interpretation and conclusion suggests that ex- 
perimentation in how to teach student teachers to teach spell- 
ing be conducted, such experimentation to embody the follow- 
ing points of emphasis : 

1. The analysis of difficulties disclosed by standard tests and frequent 
informal tests, such analysis to be followed by the correction of the 
errors made rather than by the teaching of other words of similar 
difficulty as was done in the present study. 

2. Familiarity with the most sdentificdly-determined lists of words 
in conunon use and with the most scientifically-determined methods for 
teaching such words. 

3. Definite instruction in how to teach children to want to spell 
correctly every word used and how to give them the necessary skill 
to learn such words without help from others. 


* Reed, Homer B. Psychology of Elementary School Subjects, 
p. 230. 
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Arithmetic Calculation. — ^The work in arithmetic calcula- 
tion, as outlined in the bulletins, was based upon : 

1. Diagnosis according to the Courtis Diagnostic Test. 

2. Grouping of children upon the basis of such diagnosis. 

3. Rousing desire for improvement through records of achievement, 
frequent testing, and establishment of definite goals. 

4. Frequent informal tests. 

5. Study of children to note individual poor study habits and the 
correction of such habits. 

6. Keeping up interest through variety of drill. 

(Bulletins 3. 6 , 7, 10, 11, 12, 13, 14, 15, 17, ip.) 

Like the work in spelling, the test-determined instruction 
in arithmetic calculation was based upon the analysis of errors 
made. This analysis differed, however, from that of the 
analysis of the spelling, inasmuch as the arithmetic analysis 
was based upon a definite diagnostic test, The Courtis Cleve- 
land Survey Test, designed to indicate weaknesses which 
must he overcome if skill in arithmetic is to be acquired. 

While learning to spell one word is of doubtful value in 
learning to spell other words, skill in arithmetic calculation, 
on the other hand, is definitely dependent upon the mastery 
of elements which are used again and again in the more com- 
plex processes. Hence, the basic drill in fundamentals out- 
lined in the bulletins can be expected to function in different 
arithmetic situations to a far greater extent than can the work 
in spelling be expected to function in other spelling situations. 
While it is impossible to check the test-detennined instruction 
in arithmetic against the final tests given as was done in the 
case of spelling, such tests of necessity contained many of 
the identical arithmetic elements practiced. 

It is, therefore, concluded that the results obtained are such 
as might be expected because of the hierarchical character of 
the elements of arithmetic, its improvability through definite 
practice, and the validity of the final tests as measures of the 
test-determined instruction. It is further concluded that the 
results justify the continuance of the training of student 
teachers to use the results of standard tests in arithmetic in 
their instruction of children, 

Reading. — The test-determined instruction in reading as 
outlined in the bulletins included the following : 



INTERPRETATION OF DATA AND CONCLUSIONS 13I 

1. Rousing desire for improvement through reeords of achievement, 
frequent testing, and establishment of definite goals. 

2. Grouping the children as need was shown by the results of the 
Stanford Achievement Test for special work in vocabulary, sentence 
meaning, and paragraph meaning. 

3. Further analysis of reading difficulty through the use of the 
Jones Vocabulary Test, The Gray Oral Reading Test, and through 
observing evidences of poor reading habits. 

4. The use (in the third term) of intensive reading exercises graded 
in difficulty on the basis of the reading level attained as indicated in 
the Thorndike McCall Test, the children advancing individually as 
they mastered each exercise. 

5. The use of independent extensive reading through the provision 
of interesting material, each child being permitted to read at his own 
pleasure. 

6. The use of many other accepted remedial measures in reading. 

(Bulletins i, 4, 6, 7, 9, 10, ii, 12, 13, 14, 15, 17.) 

Not only was more time spent on test-determined instruc- 
tion in reading than on any other subject, but much more 
elaborate planning was done for it. That the results were not 
as clear-cut as they were in arithmetic may be attributable, 
in the main, to the complexity of the reading process and to 
the complexity of the method used in the present study. The 
work entailed not only much more immediate preparation on 
the part of the student teacher but involved also problems of 
teaching technique and class management that might well tax 
the resources of an Inexperienced student teacher. 

The final tests, inasmuch as they included exercises in 
vocabulary meaning, sentence meaning, and paragraph mean- 
ing, followed, in method, much the line of the test-determined 
instruction and since the test-determined instruction further 
was based upon reading material selected on the basis of diffi- 
culty just within the range of the children’s varying abilities 
indicated by their test results, the final tests can be considered 
valid measures of the test-determined instruction. Since, 
moreover, the same methods used in this experiment have 
brought results not only in other experiments but in many 
public school systems, it seems reasonable to conclude that in 
the case of reading, the slightness of the advantage of the 
experimental group over the control is due primarily to the 
dUKctilty of the reading process and of the reading method 
used when handled by the inexperienced student teacher. This 
conclusion is suggestive of the further experimentation 
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needed along the same general lines as the present study but 
differing from this in the use of a simpler method of test- 
determined instruction before definite conclusion can be 
reached as to the value of teaching students to use the results 
of tests in reading in their instruction of children. 

Arithmetic Problem Solution — ^The test-determined in- 
struction in arithmetic problem solution consisted of . 

1 Rousing desire for improvement through records of achievement, 
testing, and establishment of defimte goals 

2 Analysis of errors in problem solution made by the pupils in the 
Buckingham Scale for Problems in Arithmetic 

3 Drill in problem solution based upon class errors with subsequent 
division of the class into groups for further work as needed 

4. Emphasis in instruction upon 
a Use of material varied and true to fact 
b Thoughtful reading of problems 

c Formation of certain clearly defined habits m problem solution, 
e g , noting what is given in the problem, what is required, and making 
decision as to the process to be used 
d Study of arithmetic data for the purpose ot finding possible 
resulting problems 

tBulletms 6, 7, 8, 10, ii, 14, 17, 19 ) 

The lack of clear-cut results may be attributable to the fact 
that less time was given to test-determined instruction in prob- 
lem solution than to any other one of the subjects, the time 
given to problem solution approximating but one-third of the 
time given to reading Some of the gam that was made may 
be attributable to transfer from the test-determined instruc- 
tion in reading, since, as has been brought out by P. R Stev- 
enson/ E. Wilson and others, the ability to solve problems is, 
to so great an extent, dependent upon reading ability. 

Stevenson ■* recommends in addition to the instructional 
points emphasized above, practice in solving problems with- 
out numbers, in dramatizing problems, and definite study of 
arithmetic vocabulary E Wilson ' stresses “ reading inter- 
esting situations into facts ” On the other hand, scepticism 
IS expressed as to the value of any arithmetic drill in problem 

* Stevenson, P R “ Difficulties in Problem Solving,” Journal of 
Educational Research, XI, 1925, pp 95-103 
’ Wilson, E “ Improving the Ability to Read Arithmetic Problems,” 
Elementary School Journal, XXII, 1922, pp 380-6 
“Stevenson, /bid 
’Wilson, Ibid 
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solution. Leta S. Hollingworth, for example, says, “ Ability 
in problem solving can probably not be much affected by drill, 
since ‘ a problem ’ is, by definition, something that requires 
independent adjustment, and not the response of automatic 
habit. It, therefore, calls on general intelligence and cannot be 
improved after the mechanics of reading and calculating have 
been mastered up to the limits of capacity.” ' Hamilton voices 
a similar attitude as follows : “ Every problem is less of a 
problem to the extent to which it can be solved by memory of 
the method by which similar problems have previously been 
solved. The expression, ‘ drill in problem-solving,’ which 
some writers have employed is, therefore, a misnomer for, in 
so far as previous experience in the form of the drill referred 
to enables an exercise to be solved that exercise is not a 
problem.” ’ 

As opposed to the above doubt of the utility of drill in 
problem solution, R. S. Newcomb supports his thesis that 
pupils can be taught to solve problems in arithmetic by the 
following quotation from Thorndike : “ Reasoning or selec- 
tive, inferential thinking is not at all opposed to or indepen- 
dent of the laws of habit, but really is their necessary result 
under the conditions imposed by man’s nature and training. 
A closer examination of selective thinking will show that no 
principle beyond the laws of readiness, exercise, and effect 
are needed to explain it.” 

In the absence of conclusive experimental evidence as to 
the improvability of arithmetic problem solution, either by 
the methods used in this experiment or in any other, the test- 
determined instruction in problem solution used can neither 
be supported nor condemned with any degree of certainty. 
The method outlined in the bulletins for the students was 
comparatively simple and should not have been nearly so 
great a tax as the reading method. Since the test-determined 
instruction was based upon the analysis of the difficulties 
revealed by the Buckingham Test, the final test might be con- 

’ Hollingsworth, Ibid., p. l. 

“ Hamilton, E. R. “ Insight and Skill in Arithmetic,” Journal of 
Educational Research, XII, 1925, pp. 136-44. 
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sidered a valid measure of the instruction. In interpreting 
these results it is important to bear in mind that the time spent 
on this phase of the work was comparatively small. It is, there- 
fore, concluded that the slight advantage of the experimental 
group is indicative of a probable value in teaching students to 
use the residts of tests in problem solution, but that the evi- 
dence is not conclusive. 

Summary. — The conclusions derived from the study of the 
progress of the pupils may be summarized as follows : 

1. There is indication that there is some value in teaching 
students to use the results of general and diagnostic tests in 
their instruction of children, but the data suggest that there 
may be varying degrees of value in the different subjects 
tested: reading, spelling, arithmetic calculation, and arith- 
metic problem solution. 

2. The definite results obtained in arithmetic calculation 
indicate more value in the use of the method in this subject 
than in the others. 

3. The failure to obtain results in spelling suggests the 
need for further experimentation in which the emphasis is 
changed from grouping by type difficulty as in the present 
experiment to correction of the specific errors revealed in 
tests and to the cultivation of the habit of learning to spell 
correctly all words need ' \ 

4. The slight advanlag - gained in reading as against the 
comparatively large amount of time used in test-determined 
instruction in this subject suggest the comparative teaching 
difficulties encountered by the student in teaching it and indi- 
cate the need for devising a simpler technique before putting 
test-determined instruction in this subject to further experi- 
mental test. 

5. The results in arithmetic problem solution are sugges- 
tive of the value of the method used, but further experimen- 
tation along the same lines is needed. 

6. The greater degree of correlation between initial status 
and gains in the experimental group is further evidence of the 
value of the experimental method, but the lesser correlation 
between mental age and gains when chronological age is con- 
stant is an indication that the method in the hands of the 
student teacher does not sufficiently favor the superior child. 
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2 . THE SUBORDINATE CRITERION : THE SUCCESS OF THE 
STUDENT TEACHER 

As was suggested in the beginning, the whole matter of 
teacher rating is too debatable to warrant drawing any con- 
clusions of worth from the results of the present experiment 
in terms of the final rating of the students. The fact that the 
average student teaching rating of the city, of the rural, and 
of the total group was slightly higher in the experimental than 
in the control is taken merely as very slight additional evi- 
dence of the value of the experimental method used. 

It may be of some interest to compare the coefficients of 
correlation obtained between the final student teacher rating 
and certain other factors with similar coefficients obtained 
by Knight between general teaching ability of experienced 
teachers and other factors.* 


Present Study 



Kmght*s Study 


f Student Tchg. and Ex. 

C. 

r General Tchg. and 


Initial rating 

.422 

.385 



1 , E. R. Intelligence 

.038 

—.035 

Intelligence 

.164 

Jr. Sch. Grades City 

Jr. Sch. Grades Campus 

.025 

.242 

Normal Sch. Grades 

•147 

and Rural 

.518 

421 



Chr. Age 

.289 

.144 

Chr. Age 

.082 


While the data are not strictly comparable since Knight’s 
correlations are calculated between general teaching ability 
and other factors while the correlations in the present study 
are calculated between student teaching and other factors, 
they are corroboratory in the case of intelligence, chronologi- 
cal age, and the city Junior Scholarship Grades. The differ- 
ence between the correlation between city junior scholarship 
grades and student teaching grades on the one hand and rural 
junior scholarship grades and student teaching grades on the 
other is interesting since the scholarship grades for the city 
students were given in the city training school before it was 
merged with the normal school and thus represents the ratings 
of a different group of instructors from those who rated the 
rural students. The difference suggests the possibility that 

’ Knight, F. B. Qualities Related to Success in Teaching, Teach- 
ers College, Columbia University Contributions to Education, No. 120, 
p. 40. 

TO 
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the more intimate knowledge of the rural students because of 
their additional year on the campus may have affected the 
student teaching grades, thus raising the correlation. If so, 
this might be considered as evidence of the difficulty of mak- 
ing a purely objective rating of teaching, uninfluenced by 
previous knowledge of the teacher. 

While the subordinate criterion adds little, if anything, to 
the measure of the worth of the method here used, the diaries 
of the student teachers show evidences of the careful obser- 
vation of the children resulting from the experimental work. 
While the data afford no means of measuring such value, it 
is highly probable that a method resulting in the focussing 
of the attention of the teacher upon the individual needs of 
the children will secure improved teaching results. 

Summary. — ^The results judged by the subordinate criterion 
of the student teaching grades may be considered corrobora- 
tory of the results indicated by the main criterion, though 
subject to the serious limitations of the lack of objectivity in 
teacher rating, and, hence, not reliable. Evidence in the diary 
blanks of the students indicative of careful observations of 
the pupils by the student teachers suggests further value of 
the method, but the data offer no proof of this point. 



CHAPTER XI 

Other Problems Suggested by the Data 

Five major problems were suggested by the data of the 
present study. A brief statement of each will be given. 

The Administration of Courses in Tests and Mea- 
surements. — ^A problem in this field was suggested by the 
answers to the questionnaires sent to teacher training insti- 
tutions (Chapter i). The following procedures in adminis- 
tering courses in tests and measurements were either ex- 
pressed or implied in the answers : 

1. A course in tests and measurements followed by practice in their 
use during student teaching. 

2. The tests and measurements involved in the various subjects 
taught in the professionalized subject matter courses; e. g., arithmetic 
measurements in arithmetic courses, reading measurements in reading 
courses, etc. 

3. Tests and measurements included under the study of such topics 
as intelligence and individual differences in courses in psychology. 

If it is granted that the teaching of tests and measurements 
should be part of the normal school program, it is of impor- 
tance to know which of these procedures will produce the 
best results in terms of teaching skill of the students. This 
problem is suggestive of a large group of problems the solu- 
tion of which would determine the best of several ways of 
administering normal school courses. 

The Relative Value of Pre-Service and In-Service 
Training in the Use of Tests and Measurements. — 
The results of the present study indicate that there is some 
slight value in teaching student teachers to use the results of 
tests and measurements. It is possible, however, that such 
instruction might be more economically given and be more 
effective if deferred until after the student has entered the 
actual teaching field. This possibility suggests the problem: 
Can courses in tests and measurements be more efficiently 
given during the pre-service or the in-service training of 


137 



138 OTHER PROBLEMS SUGGESTED BY THE DATA 


teachers ? Again, this problem is typical of a broad range of 
research having for its object the determination of the most 
effective period in the training of teachers for giving instruc- 
tion in the various elements comprising teacher training 
preparation. 

Difference in Intelligence Status of the Rural and 
THE City Student. — In equating groups of student teachers 
according to intelligence, it was noted that the city students 
ranked considerably higher in the I. E. R. Intelligence Test 
than the rural students (Figures 6 and 7). These data sug- 
gest the need for determining the essential differences between 
the city and rural students which cause the difference in in- 
telligence rating. To discover these differences should be of 
practical importance in determining how best to meet the 
needs of these two groups of students. 

The Problem of Teacher Rating. — The difficulty ex- 
perienced in applying the subordinate criterion, the final rat- 
ing of the student teachers, suggests that the study of teacher 
rating might well he made part of the normal school program 
of research, A normal school offers unusual opportuni- 
ties for wrestling with this baffling problem since student 
teachers are, of necessity, under very dose supervision of a 
number of trained observers. Hence, the situation provides 
to a degree perhaps not obtainable otherwise opportunities 
for applying the test of objectivity ; i. e., that a scale should 
yield the same results regardless of the individuality of the 
one using the scale. 

The Values Resulting from the Rating of Teach- 
ers. — Another profitable study in this connection might be 
made of the values resulting from the rating of teachers. It is 
the opinion of the writer that there is but little such value. 
Observation over a period of years has indicated that the 
emotional reaction to a rating seems to outweigh any other 
value it might have. If a valid criterion can be found for 
measuring the results in terms of the growth of the pupils 
taught, a study might well be made of the relative value of 
the rating as against the non-rating of teachers. 
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APPENDIX A 


Courses in Educational Measurements in Teacher 
Training and Normal Schools 
I 

I. Catalogue name or names of courses in which training in the 
use of educational tests and measurements is given 


2. Enrollment: 

a. In entire school 

b. In each course in educational tests and measurements 

c. Are such courses required or elective? 

3. Teaching Staff: 

a. Number on entire staff of school 

b. Number teaching courses in educational tests and measurements: 

l'. Number devoting entire time to such courses 

3 t. Number giving part time to such courses 

3'. Where part time is given, state the fraction of entire teaching 
time given to such instruction 

4. School Year: 

a. Length of school year in weeks 

b. Length of each course in educational tests and measurements 

in weeks 


II 

5, Salaries: 

a. Total expenditure made upon salaries of the entire teaching staff 

during 1923-24 

b. Total expenditure made upon salaries of instructors giving courses 
in tests and measurements during 1923-24: 

1'. Of those devoting entire time to such instruction 

a'. Of those giving part time to such instruction 

6. Expenditures other than salaries: 

a. Total expenditure made on equipment and supplies used in con- 
ducting courses in educational tests and measurements during 1923-24 


b. Total expenditure on assistance other than costs of instruction 
made during 1923-24 


Ill 

7. Testing program in schools outside your own institution: 

a. How many schools were so used? 

b. How many individuals were tested? 

c. How many different tests were used? 

8. Cost of testing program: 

a. What was the total cost of this testing program (exclusive of 

all expenditures listed under II.) 

b. Of this sum, what amount was spent upon testing materials? 


142 




APPENDICES 


143 


c. How much of the cost of the testing program was defrayed by 

your institution? 

d. What amount, if any, was contributed by other sources? 

Indicate the sources 

9. Was any use other than the most effective training of students 

made of the data gathered in the testing program? 

Indicate the uses, if any 

Date 

Signed 

Office ■ 

Note. — The questionnaire sent to departments and schools of edu- 
cation in colleges and universities was similar to this one, being merely 
modified in a few details to suit the differences in organization of the 
two types of institution. 


APPENDIX B 

Cooperation of Bureaus of Educational Research with 
Teacher Training Institutions 
I 

I. Do you cooperate with any teacher training institution or depart- 
ment or school of education of a college or university? 

If so, give name and location of such institution 


II 

2. Does such cooperation irulude the giving of courses in educational 

measurements in such institution by members of your staff? 

3. Give the length of such courses in weeks per year 

Number periods per week length of periods 

4. Is the cost of such instruction met ; 

a. Entirely by the teacher training institution? 

b. Entirely by the bureau of research? 

c. By the bureau of research and teacher training institution co- 
operatively? 

5. Indicate the amount appropriated for 1923-24 by the bureau of 

research for such instructional purposes 

Ill 

6. Are you engaged in any testing program in cooperation with the 

teacher training institution ? 

y. Estimate after each of the following items the amount spent 
during 1923-24 in connection with such progtram: 

a. Testing materials 

b. Equipment for experimental teaching 

c. Clerical assistance 

d. Office supplies 

e. Postage 

f. Any other item (indicate its character) 

8. Estimate the total amount spent during 1923-24 upon such 
cooperative programs 

9- What benefits, if any, do you consider result from such coopera- 
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APPENDIX C 

Instructions for Keeping Diary of Test^Determined 
Instructions 

(For Student Teachers in Experimental Classes) 

I. The diary blanks which you are asked to keep are essential in 
evaluating the results of the test-determined instruction in reading, 
spelling and arithmetic which you are asked to give. Accuracy is 
essential. 

Fill in a diary blank as soon after giving a test-determined lesson 
as possible. 

Keep the diary blanks in a filing folder or in a loose-leaf note book 
cover available for study by the teacher of practice or the experi- 
menter at any time. 

II. Observe the following explanation of items used on the diary 
blanks : 

7. If the time of the lesson is divided between groups, indicate which 
groups were taught; e. g. — ^vocabulary group, sratence meaning 
group, etc. After each group, indicate whether the activity was directed 
or undirected. 

8. Types of instruction. — ^Use the same terms as used on the shwts 
of instructions for test-determined reading, arithmetic, and spelling. 

g. Materials Used : 

a. Give in every case the source of the materials used ; text books, 
books other than text books, magazines, drill devices, other school 
activities, etc. Indicate the amount of such material used: pages or 
paragraphs, or number of words, or number of problems according 
to the material used. 

b. If spelling is not taken from text, write the words. 

c. If arithmetic is not taken from a text, give a sufficient number 
of the examples or problems to show the types used. 

10. Comments; 

Indicate any conditions or occurrences, beneficial or detrimental, that 
mi|;ht have influenced the results of the work; e. g. — interruptions, 
attitude of children. 

11. Disciplinary Cases: 

Give the name of the child and the nature of the offense of any 
disciplinary case that occurred which was of such character as to 
interrupt the lesson. 

APPENDIX D 

Form 2 

DI.\RV — ^TEST-DETERMINED INSTRUCTION 

I. School 2. Grade 3. Date 4. Time 

Activity i From 

To 

“ 2 From 

To 

“ 3 From 

To 

5. No. of Minutes 

6. Subject 

7. Group or class 
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8. Types of Instruction: 

Activity I 
" 3 

“ 3 

g. Materials Used 

10. Comments 

11. Disciplinary Cases 

13 . Absent Signed 

Student Teacher 

APPENDIX E 

Sample op Score Sheet for Reading Tests Sent to Experimental 
Classes with Bulletin i 

October, 1924 

experimental class b 


Pupil 

Monroe 


Stanford 


Thorndike 

Monroe 








Num. 

Comp. 

Vocab. 

SenL 

Par. 

McCall 

Kate 

I 

3 






2 

4 

16 

17 

14 

32 

6 t 

3 

4 

14 

6 

10 

24 

206 

4 

4 






S 

6 

13 

14 

22 

37 

74 

6 

6 






7 

6 

II 

IS 

32 

31 

112 

8 

6 

12 

8 

26 


86 

9 

7 

28 

34 

48 

34 

1 12 

10 

7 

31 

28 

48 


99 

II 

7 

12 

24 

20 

34 

las 

13 

8 

26 

20 

24 

40 

ISO 

13 

8 

28 

36 

18 

38 

206 

14 

9 

19 

21 

36 

36 

150 

IS 

9 

16 

14 

22 

34 

125 

16 

9 

24 

32 

36 

32 

125 

17 

9 




32 

136 

18 

10 

24 

lO 

38 

34 

146 

19 

10 

18 

22 

24 

36 

ISO 

30 

10 

27 

30 

28 

40 

150 

21 

10 

27 

30 

S 6 

40 

125 

22 

10 

2 S 

14 

18 

35 

159 

23 

10 

19 

10 

20 

34 

146 

24 

II 

23 

31 

30 

49 

146 

2 S 

11 

32 

34 

28 

43 

159 

26 

11 





159 


II 

28 

33 

48 

43 

146 

28 

11 




43 

206 

29 

12 

42 

18 

60 

43 

183 

30 

12 

38 

26 

62 

3 ? 

206 

31 

12 

23 

38 

54 

38 

171 

32 

12 

39 

39 

60 

47 

183 

33 

12 

30 

28 

46 

37 

159 

34 

14 

40 

39 

6z 

41 

2o6 

35 

14 

28 

26 

46 

37 

193 

Av. 

9 

24.6 

23.8 

38.2 

36. S 

144.8 

Grade 






norms : 







3rd 

10.4 

12.3 

33-4 

37.3 (end) 


4 th 7.7 

26.9 

24.1 

4 S -4 

q 9 .t) 

122 


(beginning) 




(middle) 
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APPENDIX F 

Sample of Suggestions for Grouping in Reading Sent with 
Bulletin 1 

Experimental Class B 

N. B. Key numbers for pupils refer to reading score sheets. 
remedial policies in vocabulary 

Pupils 2, 3, 5. 7, 8, II, IS, 16, 18, 19, 23. 

remedial policies IN SENTENCE MEANING 
Pupils 2, 3, S, 7, 8, II, 12, 14, IS, 18, 22, 23, 29. 

REMEDIAL POLICIES IN PARAGRAPH MEANING 

Pupils 2, 3, s. 7 , 8. 9 . II. 12 . 13. 14. IS. 16. i 7 . 18, 19. 20, 22, 23, 25. 

PUPILS NOT IN NEED OF REMEDIAL MEASURES 

Pupils 27, 30, 31, 32. 33 . 34 . 3 S. 21. 24, 26, 28. 

NOTES 

1. Pupils 3 and 13 are probably reading too fast. 

2. Indude Pupils I, 4. 6 (absent for Stanford Test) in vocabulary 
test 




